2023-03-30 16:53:28,244 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-30 16:53:28,514 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8 2023-03-30 16:53:28,528 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-30 16:53:28,529 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77, deleteOnExit=true 2023-03-30 16:53:28,529 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-30 16:53:28,529 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/test.cache.data in system properties and HBase conf 2023-03-30 16:53:28,530 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/hadoop.tmp.dir in system properties and HBase conf 2023-03-30 16:53:28,530 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/hadoop.log.dir in system properties and HBase conf 2023-03-30 16:53:28,531 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-30 16:53:28,531 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-30 16:53:28,531 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-30 16:53:28,653 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-30 16:53:29,074 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-30 16:53:29,079 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-30 16:53:29,080 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-30 16:53:29,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-30 16:53:29,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-30 16:53:29,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-30 16:53:29,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-30 16:53:29,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-30 16:53:29,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-30 16:53:29,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-30 16:53:29,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/nfs.dump.dir in system properties and HBase conf 2023-03-30 16:53:29,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/java.io.tmpdir in system properties and HBase conf 2023-03-30 16:53:29,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-30 16:53:29,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-30 16:53:29,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-30 16:53:29,693 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-30 16:53:29,698 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-30 16:53:29,993 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-30 16:53:30,174 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-30 16:53:30,201 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-30 16:53:30,243 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-30 16:53:30,276 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/java.io.tmpdir/Jetty_localhost_40761_hdfs____86ggw/webapp 2023-03-30 16:53:30,418 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40761 2023-03-30 16:53:30,481 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-30 16:53:30,481 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-30 16:53:30,957 WARN [Listener at localhost/37679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-30 16:53:31,103 WARN [Listener at localhost/37679] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-30 16:53:31,126 WARN [Listener at localhost/37679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-30 16:53:31,133 INFO [Listener at localhost/37679] log.Slf4jLog(67): jetty-6.1.26 2023-03-30 16:53:31,138 INFO [Listener at localhost/37679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/java.io.tmpdir/Jetty_localhost_41833_datanode____mg9aw2/webapp 2023-03-30 16:53:31,234 INFO [Listener at localhost/37679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41833 2023-03-30 16:53:31,653 WARN [Listener at localhost/41799] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-30 16:53:32,177 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x76e65ccfcac8f7ea: Processing first storage report for DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09 from datanode 3bd02d61-c173-4cd3-a740-242f059d5e2c 2023-03-30 16:53:32,179 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x76e65ccfcac8f7ea: from storage DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09 node DatanodeRegistration(127.0.0.1:34103, datanodeUuid=3bd02d61-c173-4cd3-a740-242f059d5e2c, infoPort=37641, infoSecurePort=0, ipcPort=41799, storageInfo=lv=-57;cid=testClusterID;nsid=2130933171;c=1680195209774), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-30 16:53:32,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x76e65ccfcac8f7ea: Processing first storage report for DS-8645ef0d-692e-4a4f-9339-511fee950515 from datanode 3bd02d61-c173-4cd3-a740-242f059d5e2c 2023-03-30 16:53:32,180 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x76e65ccfcac8f7ea: from storage DS-8645ef0d-692e-4a4f-9339-511fee950515 node DatanodeRegistration(127.0.0.1:34103, datanodeUuid=3bd02d61-c173-4cd3-a740-242f059d5e2c, infoPort=37641, infoSecurePort=0, ipcPort=41799, storageInfo=lv=-57;cid=testClusterID;nsid=2130933171;c=1680195209774), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-03-30 16:53:32,188 DEBUG [Listener at localhost/41799] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8 2023-03-30 16:53:32,270 INFO [Listener at localhost/41799] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77/zookeeper_0, clientPort=64100, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-30 16:53:32,285 INFO [Listener at localhost/41799] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64100 2023-03-30 16:53:32,292 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:32,295 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:32,973 INFO [Listener at localhost/41799] util.FSUtils(471): Created version file at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70 with version=8 2023-03-30 16:53:32,973 INFO [Listener at localhost/41799] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/hbase-staging 2023-03-30 16:53:33,286 INFO [Listener at localhost/41799] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-30 16:53:33,812 INFO [Listener at localhost/41799] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-03-30 16:53:33,844 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-30 16:53:33,844 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-30 16:53:33,845 INFO [Listener at localhost/41799] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-30 16:53:33,845 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-30 16:53:33,845 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-30 16:53:34,001 INFO [Listener at localhost/41799] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-30 16:53:34,074 DEBUG [Listener at localhost/41799] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-30 16:53:34,173 INFO [Listener at localhost/41799] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44093 2023-03-30 16:53:34,183 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:34,186 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:34,206 INFO [Listener at localhost/41799] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44093 connecting to ZooKeeper ensemble=127.0.0.1:64100 2023-03-30 16:53:34,249 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:440930x0, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-30 16:53:34,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44093-0x10136583da40000 connected 2023-03-30 16:53:34,279 DEBUG [Listener at localhost/41799] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-30 16:53:34,280 DEBUG [Listener at localhost/41799] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-30 16:53:34,283 DEBUG [Listener at localhost/41799] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-30 16:53:34,291 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44093 2023-03-30 16:53:34,291 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44093 2023-03-30 16:53:34,291 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44093 2023-03-30 16:53:34,292 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44093 2023-03-30 16:53:34,292 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44093 2023-03-30 16:53:34,298 INFO [Listener at localhost/41799] master.HMaster(444): hbase.rootdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70, hbase.cluster.distributed=false 2023-03-30 16:53:34,376 INFO [Listener at localhost/41799] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-03-30 16:53:34,377 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-30 16:53:34,377 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-30 16:53:34,377 INFO [Listener at localhost/41799] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-30 16:53:34,378 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-30 16:53:34,378 INFO [Listener at localhost/41799] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-30 16:53:34,383 INFO [Listener at localhost/41799] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-30 16:53:34,385 INFO [Listener at localhost/41799] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39029 2023-03-30 16:53:34,388 INFO [Listener at localhost/41799] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-30 16:53:34,396 DEBUG [Listener at localhost/41799] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-30 16:53:34,397 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:34,400 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:34,402 INFO [Listener at localhost/41799] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39029 connecting to ZooKeeper ensemble=127.0.0.1:64100 2023-03-30 16:53:34,405 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:390290x0, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-30 16:53:34,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39029-0x10136583da40001 connected 2023-03-30 16:53:34,406 DEBUG [Listener at localhost/41799] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-30 16:53:34,408 DEBUG [Listener at localhost/41799] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-30 16:53:34,409 DEBUG [Listener at localhost/41799] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-30 16:53:34,409 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39029 2023-03-30 16:53:34,412 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39029 2023-03-30 16:53:34,412 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39029 2023-03-30 16:53:34,413 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39029 2023-03-30 16:53:34,413 DEBUG [Listener at localhost/41799] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39029 2023-03-30 16:53:34,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:34,426 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-30 16:53:34,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:34,445 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-30 16:53:34,445 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-30 16:53:34,445 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:34,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-30 16:53:34,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44093,1680195213114 from backup master directory 2023-03-30 16:53:34,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-30 16:53:34,452 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:34,452 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-30 16:53:34,453 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-30 16:53:34,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:34,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-30 16:53:34,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-30 16:53:34,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/hbase.id with ID: 1fe52a8b-1d6e-41c0-8bba-28e20e30bd1a 2023-03-30 16:53:34,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:35,007 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:35,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x03a472e5 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:53:35,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b266e3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:53:35,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-30 16:53:35,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-30 16:53:35,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-30 16:53:35,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-30 16:53:35,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-30 16:53:35,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-30 16:53:35,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-30 16:53:35,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store-tmp 2023-03-30 16:53:35,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:35,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-30 16:53:35,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:53:35,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:53:35,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-30 16:53:35,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:53:35,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:53:35,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-30 16:53:35,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/WALs/jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:35,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44093%2C1680195213114, suffix=, logDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/WALs/jenkins-hbase4.apache.org,44093,1680195213114, archiveDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/oldWALs, maxLogs=10 2023-03-30 16:53:35,685 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34103,DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09,DISK] 2023-03-30 16:53:35,693 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-30 16:53:35,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/WALs/jenkins-hbase4.apache.org,44093,1680195213114/jenkins-hbase4.apache.org%2C44093%2C1680195213114.1680195215644 2023-03-30 16:53:35,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34103,DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09,DISK]] 2023-03-30 16:53:35,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:53:35,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:35,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-30 16:53:35,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-30 16:53:35,827 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-30 16:53:35,833 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-30 16:53:35,856 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-30 16:53:35,868 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:35,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-30 16:53:35,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-30 16:53:35,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-30 16:53:35,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:53:35,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70607963, jitterRate=0.05214063823223114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:53:35,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-30 16:53:35,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-30 16:53:35,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-30 16:53:35,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-30 16:53:35,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-30 16:53:35,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-30 16:53:35,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 30 msec 2023-03-30 16:53:35,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-30 16:53:35,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-30 16:53:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-30 16:53:36,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-30 16:53:36,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-30 16:53:36,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-30 16:53:36,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-30 16:53:36,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-30 16:53:36,021 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:36,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-30 16:53:36,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-30 16:53:36,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-30 16:53:36,040 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-30 16:53:36,040 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-30 16:53:36,040 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:36,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44093,1680195213114, sessionid=0x10136583da40000, setting cluster-up flag (Was=false) 2023-03-30 16:53:36,055 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:36,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-30 16:53:36,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:36,067 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:36,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-30 16:53:36,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:36,077 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp 2023-03-30 16:53:36,119 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(952): ClusterId : 1fe52a8b-1d6e-41c0-8bba-28e20e30bd1a 2023-03-30 16:53:36,125 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-30 16:53:36,131 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-30 16:53:36,131 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-30 16:53:36,136 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-30 16:53:36,136 DEBUG [RS:0;jenkins-hbase4:39029] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc9aab2 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:53:36,142 DEBUG [RS:0;jenkins-hbase4:39029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@720e4b5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:53:36,143 DEBUG [RS:0;jenkins-hbase4:39029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7631c1c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-30 16:53:36,170 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39029 2023-03-30 16:53:36,174 INFO [RS:0;jenkins-hbase4:39029] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-30 16:53:36,174 INFO [RS:0;jenkins-hbase4:39029] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-30 16:53:36,174 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1023): About to register with Master. 2023-03-30 16:53:36,177 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44093,1680195213114 with isa=jenkins-hbase4.apache.org/172.31.14.131:39029, startcode=1680195214375 2023-03-30 16:53:36,194 DEBUG [RS:0;jenkins-hbase4:39029] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-30 16:53:36,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-30 16:53:36,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-30 16:53:36,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-30 16:53:36,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-30 16:53:36,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-30 16:53:36,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-03-30 16:53:36,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-30 16:53:36,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1680195246225 2023-03-30 16:53:36,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-30 16:53:36,231 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-30 16:53:36,231 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-30 16:53:36,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-30 16:53:36,240 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-30 16:53:36,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-30 16:53:36,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-30 16:53:36,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-30 16:53:36,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-30 16:53:36,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-30 16:53:36,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-30 16:53:36,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-30 16:53:36,258 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44243, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-30 16:53:36,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-30 16:53:36,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-30 16:53:36,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1680195216261,5,FailOnTimeoutGroup] 2023-03-30 16:53:36,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1680195216262,5,FailOnTimeoutGroup] 2023-03-30 16:53:36,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-30 16:53:36,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:36,290 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70 2023-03-30 16:53:36,290 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37679 2023-03-30 16:53:36,290 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-30 16:53:36,295 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-30 16:53:36,295 DEBUG [RS:0;jenkins-hbase4:39029] zookeeper.ZKUtil(162): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:36,296 WARN [RS:0;jenkins-hbase4:39029] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-30 16:53:36,296 INFO [RS:0;jenkins-hbase4:39029] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-30 16:53:36,297 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/WALs/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:36,297 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39029,1680195214375] 2023-03-30 16:53:36,305 DEBUG [RS:0;jenkins-hbase4:39029] zookeeper.ZKUtil(162): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:36,314 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-30 16:53:36,322 INFO [RS:0;jenkins-hbase4:39029] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-30 16:53:36,340 INFO [RS:0;jenkins-hbase4:39029] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-30 16:53:36,343 INFO [RS:0;jenkins-hbase4:39029] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:53:36,343 INFO [RS:0;jenkins-hbase4:39029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,344 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-30 16:53:36,351 INFO [RS:0;jenkins-hbase4:39029] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,351 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,352 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,353 DEBUG [RS:0;jenkins-hbase4:39029] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-30 16:53:36,353 INFO [RS:0;jenkins-hbase4:39029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,353 INFO [RS:0;jenkins-hbase4:39029] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,354 INFO [RS:0;jenkins-hbase4:39029] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,368 INFO [RS:0;jenkins-hbase4:39029] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-30 16:53:36,371 INFO [RS:0;jenkins-hbase4:39029] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39029,1680195214375-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:36,387 INFO [RS:0;jenkins-hbase4:39029] regionserver.Replication(203): jenkins-hbase4.apache.org,39029,1680195214375 started 2023-03-30 16:53:36,387 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39029,1680195214375, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39029, sessionid=0x10136583da40001 2023-03-30 16:53:36,387 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-30 16:53:36,387 DEBUG [RS:0;jenkins-hbase4:39029] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:36,387 DEBUG [RS:0;jenkins-hbase4:39029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39029,1680195214375' 2023-03-30 16:53:36,387 DEBUG [RS:0;jenkins-hbase4:39029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:36,388 DEBUG [RS:0;jenkins-hbase4:39029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:36,389 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-30 16:53:36,389 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-30 16:53:36,389 DEBUG [RS:0;jenkins-hbase4:39029] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:36,389 DEBUG [RS:0;jenkins-hbase4:39029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39029,1680195214375' 2023-03-30 16:53:36,389 DEBUG [RS:0;jenkins-hbase4:39029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-30 16:53:36,389 DEBUG [RS:0;jenkins-hbase4:39029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-30 16:53:36,390 DEBUG [RS:0;jenkins-hbase4:39029] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-30 16:53:36,390 INFO [RS:0;jenkins-hbase4:39029] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-30 16:53:36,390 INFO [RS:0;jenkins-hbase4:39029] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-30 16:53:36,501 INFO [RS:0;jenkins-hbase4:39029] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39029%2C1680195214375, suffix=, logDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/WALs/jenkins-hbase4.apache.org,39029,1680195214375, archiveDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/oldWALs, maxLogs=32 2023-03-30 16:53:36,519 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34103,DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09,DISK] 2023-03-30 16:53:36,523 INFO [RS:0;jenkins-hbase4:39029] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/WALs/jenkins-hbase4.apache.org,39029,1680195214375/jenkins-hbase4.apache.org%2C39029%2C1680195214375.1680195216503 2023-03-30 16:53:36,523 DEBUG [RS:0;jenkins-hbase4:39029] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34103,DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09,DISK]] 2023-03-30 16:53:36,682 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-30 16:53:36,683 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-30 16:53:36,683 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70 2023-03-30 16:53:37,099 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:37,101 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-30 16:53:37,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/info 2023-03-30 16:53:37,105 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-30 16:53:37,106 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:37,106 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-30 16:53:37,109 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/rep_barrier 2023-03-30 16:53:37,109 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-30 16:53:37,110 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:37,110 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-30 16:53:37,112 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/table 2023-03-30 16:53:37,113 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-30 16:53:37,114 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:37,115 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740 2023-03-30 16:53:37,116 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740 2023-03-30 16:53:37,121 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-30 16:53:37,123 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-30 16:53:37,126 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:53:37,127 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66269950, jitterRate=-0.012500792741775513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-30 16:53:37,128 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-30 16:53:37,128 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-30 16:53:37,128 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-30 16:53:37,128 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-30 16:53:37,128 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-30 16:53:37,128 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-30 16:53:37,129 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-30 16:53:37,129 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-30 16:53:37,134 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-30 16:53:37,134 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-30 16:53:37,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-30 16:53:37,153 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-30 16:53:37,155 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-30 16:53:37,306 DEBUG [jenkins-hbase4:44093] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-30 16:53:37,309 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39029,1680195214375, state=OPENING 2023-03-30 16:53:37,317 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-30 16:53:37,319 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:37,320 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-30 16:53:37,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:53:37,505 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:37,508 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-30 16:53:37,511 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53236, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-30 16:53:37,521 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-30 16:53:37,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-30 16:53:37,526 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39029%2C1680195214375.meta, suffix=.meta, logDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/WALs/jenkins-hbase4.apache.org,39029,1680195214375, archiveDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/oldWALs, maxLogs=32 2023-03-30 16:53:37,542 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34103,DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09,DISK] 2023-03-30 16:53:37,546 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/WALs/jenkins-hbase4.apache.org,39029,1680195214375/jenkins-hbase4.apache.org%2C39029%2C1680195214375.meta.1680195217527.meta 2023-03-30 16:53:37,548 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34103,DS-1b406d99-59d3-48b3-a61e-5cc88fbb8f09,DISK]] 2023-03-30 16:53:37,548 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:53:37,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-30 16:53:37,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-30 16:53:37,574 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-30 16:53:37,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-30 16:53:37,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:37,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-30 16:53:37,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-30 16:53:37,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-30 16:53:37,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/info 2023-03-30 16:53:37,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/info 2023-03-30 16:53:37,585 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-30 16:53:37,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:37,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-30 16:53:37,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/rep_barrier 2023-03-30 16:53:37,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/rep_barrier 2023-03-30 16:53:37,588 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-30 16:53:37,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:37,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-30 16:53:37,591 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/table 2023-03-30 16:53:37,591 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/table 2023-03-30 16:53:37,591 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-30 16:53:37,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:37,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740 2023-03-30 16:53:37,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740 2023-03-30 16:53:37,600 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-30 16:53:37,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-30 16:53:37,605 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66909074, jitterRate=-0.0029771029949188232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-30 16:53:37,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-30 16:53:37,615 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1680195217498 2023-03-30 16:53:37,637 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-30 16:53:37,637 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-30 16:53:37,638 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39029,1680195214375, state=OPEN 2023-03-30 16:53:37,640 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-30 16:53:37,640 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-30 16:53:37,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-30 16:53:37,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39029,1680195214375 in 318 msec 2023-03-30 16:53:37,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-30 16:53:37,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 504 msec 2023-03-30 16:53:37,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5250 sec 2023-03-30 16:53:37,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1680195217654, completionTime=-1 2023-03-30 16:53:37,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-30 16:53:37,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-03-30 16:53:37,716 DEBUG [hconnection-0x4124be4e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:53:37,720 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53248, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:53:37,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-03-30 16:53:37,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1680195277737 2023-03-30 16:53:37,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1680195337737 2023-03-30 16:53:37,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 82 msec 2023-03-30 16:53:37,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44093,1680195213114-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:37,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44093,1680195213114-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:37,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44093,1680195213114-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:37,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44093, period=300000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:37,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-30 16:53:37,771 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-30 16:53:37,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-30 16:53:37,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-30 16:53:37,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-30 16:53:37,795 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:53:37,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:53:37,824 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:37,827 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811 empty. 2023-03-30 16:53:37,828 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:37,828 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-30 16:53:38,265 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-30 16:53:38,267 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f3661297582531e1192ae5a5b00b4811, NAME => 'hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:53:38,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:38,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f3661297582531e1192ae5a5b00b4811, disabling compactions & flushes 2023-03-30 16:53:38,680 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:53:38,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:53:38,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. after waiting 0 ms 2023-03-30 16:53:38,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:53:38,680 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:53:38,680 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f3661297582531e1192ae5a5b00b4811: 2023-03-30 16:53:38,686 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:53:38,700 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680195218689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195218689"}]},"ts":"1680195218689"} 2023-03-30 16:53:38,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:53:38,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:53:38,734 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195218729"}]},"ts":"1680195218729"} 2023-03-30 16:53:38,738 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-30 16:53:38,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f3661297582531e1192ae5a5b00b4811, ASSIGN}] 2023-03-30 16:53:38,750 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f3661297582531e1192ae5a5b00b4811, ASSIGN 2023-03-30 16:53:38,751 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f3661297582531e1192ae5a5b00b4811, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:53:38,902 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f3661297582531e1192ae5a5b00b4811, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:38,903 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680195218902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195218902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195218902"}]},"ts":"1680195218902"} 2023-03-30 16:53:38,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f3661297582531e1192ae5a5b00b4811, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:53:39,069 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:53:39,070 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3661297582531e1192ae5a5b00b4811, NAME => 'hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:53:39,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:39,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:39,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:39,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:39,073 INFO [StoreOpener-f3661297582531e1192ae5a5b00b4811-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:39,075 DEBUG [StoreOpener-f3661297582531e1192ae5a5b00b4811-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/info 2023-03-30 16:53:39,075 DEBUG [StoreOpener-f3661297582531e1192ae5a5b00b4811-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/info 2023-03-30 16:53:39,076 INFO [StoreOpener-f3661297582531e1192ae5a5b00b4811-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3661297582531e1192ae5a5b00b4811 columnFamilyName info 2023-03-30 16:53:39,077 INFO [StoreOpener-f3661297582531e1192ae5a5b00b4811-1] regionserver.HStore(310): Store=f3661297582531e1192ae5a5b00b4811/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:39,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:39,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:39,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3661297582531e1192ae5a5b00b4811 2023-03-30 16:53:39,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:53:39,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3661297582531e1192ae5a5b00b4811; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63956453, jitterRate=-0.046974584460258484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:53:39,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3661297582531e1192ae5a5b00b4811: 2023-03-30 16:53:39,090 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811., pid=6, masterSystemTime=1680195219062 2023-03-30 16:53:39,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:53:39,094 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:53:39,095 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f3661297582531e1192ae5a5b00b4811, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:39,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680195219095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195219095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195219095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195219095"}]},"ts":"1680195219095"} 2023-03-30 16:53:39,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-30 16:53:39,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f3661297582531e1192ae5a5b00b4811, server=jenkins-hbase4.apache.org,39029,1680195214375 in 190 msec 2023-03-30 16:53:39,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-30 16:53:39,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f3661297582531e1192ae5a5b00b4811, ASSIGN in 355 msec 2023-03-30 16:53:39,107 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:53:39,108 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195219108"}]},"ts":"1680195219108"} 2023-03-30 16:53:39,111 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-30 16:53:39,114 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:53:39,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3330 sec 2023-03-30 16:53:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-30 16:53:39,207 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-30 16:53:39,208 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:53:39,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-30 16:53:39,263 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-30 16:53:39,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-03-30 16:53:39,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-30 16:53:39,292 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-30 16:53:39,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-03-30 16:53:39,305 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-30 16:53:39,309 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-30 16:53:39,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.856sec 2023-03-30 16:53:39,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-30 16:53:39,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-30 16:53:39,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-30 16:53:39,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44093,1680195213114-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-30 16:53:39,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44093,1680195213114-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-30 16:53:39,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-30 16:53:39,327 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(139): Connect 0x561bf69b to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:53:39,332 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f0808a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:53:39,352 DEBUG [hconnection-0xcc760f5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:53:39,371 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:53:39,384 INFO [Listener at localhost/41799] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:53:39,385 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(139): Connect 0x6b586bb5 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:53:39,394 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69d78ff9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:53:39,394 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:53:39,441 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=169, AvailableMemoryMB=5388 2023-03-30 16:53:39,458 DEBUG [Listener at localhost/41799] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:53:39,462 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:53:39,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-30 16:53:39,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:39,501 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:53:39,503 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:53:39,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-30 16:53:39,510 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:39,514 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486 empty. 2023-03-30 16:53:39,517 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:39,518 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-30 16:53:39,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-30 16:53:39,604 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-30 16:53:39,608 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 530b2a08fdec00a887d0a81479c49486, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:53:39,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-30 16:53:39,641 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:39,641 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 530b2a08fdec00a887d0a81479c49486, disabling compactions & flushes 2023-03-30 16:53:39,641 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:39,641 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:39,641 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. after waiting 0 ms 2023-03-30 16:53:39,641 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:39,641 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:39,641 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:39,651 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:53:39,653 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680195219652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195219652"}]},"ts":"1680195219652"} 2023-03-30 16:53:39,657 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:53:39,659 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:53:39,660 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195219659"}]},"ts":"1680195219659"} 2023-03-30 16:53:39,662 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-30 16:53:39,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, ASSIGN}] 2023-03-30 16:53:39,671 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, ASSIGN 2023-03-30 16:53:39,673 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:53:39,825 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=530b2a08fdec00a887d0a81479c49486, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:39,825 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680195219824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195219824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195219824"}]},"ts":"1680195219824"} 2023-03-30 16:53:39,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 530b2a08fdec00a887d0a81479c49486, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:53:39,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-30 16:53:40,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:40,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 530b2a08fdec00a887d0a81479c49486, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:53:40,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:40,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:40,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:40,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:40,013 INFO [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:40,017 DEBUG [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:40,018 DEBUG [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:40,028 INFO [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 530b2a08fdec00a887d0a81479c49486 columnFamilyName family1 2023-03-30 16:53:40,053 INFO [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] regionserver.HStore(310): Store=530b2a08fdec00a887d0a81479c49486/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:40,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:40,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:40,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:40,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:53:40,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 530b2a08fdec00a887d0a81479c49486; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61081809, jitterRate=-0.08981011807918549}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:53:40,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:40,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486., pid=11, masterSystemTime=1680195219991 2023-03-30 16:53:40,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:40,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:40,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=530b2a08fdec00a887d0a81479c49486, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,093 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680195220092"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195220092"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195220092"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195220092"}]},"ts":"1680195220092"} 2023-03-30 16:53:40,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-30 16:53:40,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 530b2a08fdec00a887d0a81479c49486, server=jenkins-hbase4.apache.org,39029,1680195214375 in 267 msec 2023-03-30 16:53:40,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-30 16:53:40,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, ASSIGN in 432 msec 2023-03-30 16:53:40,108 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:53:40,108 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195220108"}]},"ts":"1680195220108"} 2023-03-30 16:53:40,112 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-30 16:53:40,117 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:53:40,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 622 msec 2023-03-30 16:53:40,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-30 16:53:40,140 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-30 16:53:40,169 DEBUG [hconnection-0x7aa6bd5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:53:40,175 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53276, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:53:40,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:40,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,430 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:40,431 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:40,431 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:40,431 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:40,432 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,432 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,434 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:40,434 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:40,434 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,435 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,436 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,440 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:40,440 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:40,441 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:40,446 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:40,446 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:40,446 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:40,447 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:40,448 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-30 16:53:40,722 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b9d3d87664b943cc8b3e1c5236fc3a7e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b9d3d87664b943cc8b3e1c5236fc3a7e 2023-03-30 16:53:40,752 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/60d269bcdb894736b283e53eb143162e 2023-03-30 16:53:40,769 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/60d269bcdb894736b283e53eb143162e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/60d269bcdb894736b283e53eb143162e 2023-03-30 16:53:40,794 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/60d269bcdb894736b283e53eb143162e, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-30 16:53:40,798 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 349ms, sequenceid=5, compaction requested=false 2023-03-30 16:53:40,801 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:40,806 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:40,806 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:40,806 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:40,810 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,810 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:40,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:40,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:40,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:40,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:40,814 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:40,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8a1eca[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:40,814 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,821 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:40,821 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:40,822 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:40,825 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:40,825 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,825 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:40,825 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:40,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:40,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:40,826 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:40,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:40,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:40,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,826 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:40,829 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,830 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:40,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,830 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:40,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:40,833 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,837 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:40,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,847 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:40,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:40,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:40,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:40,849 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:40,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:40,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,849 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,849 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,849 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:40,852 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:40,852 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:40,952 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:40,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:40,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:40,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:40,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,988 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:40,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:40,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:40,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:40,990 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,990 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,994 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:40,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:40,994 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,995 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:40,996 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:40,998 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,000 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:41,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,000 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:41,000 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:41,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:41,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:41,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:41,001 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:41,004 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:41,005 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-30 16:53:41,076 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f0ed6c9756ea4560acda3bd768872fc7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f0ed6c9756ea4560acda3bd768872fc7 2023-03-30 16:53:41,173 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/edfe2cde472244f5907452c1a638d720 2023-03-30 16:53:41,185 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/edfe2cde472244f5907452c1a638d720 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/edfe2cde472244f5907452c1a638d720 2023-03-30 16:53:41,195 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/edfe2cde472244f5907452c1a638d720, entries=1, sequenceid=9, filesize=5.0 K 2023-03-30 16:53:41,197 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 192ms, sequenceid=9, compaction requested=false 2023-03-30 16:53:41,198 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:41,198 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:41,198 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:41,206 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,206 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:41,207 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,207 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:41,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:41,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:41,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:41,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b561ef4[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:41,210 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:41,210 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,212 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,212 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:41,212 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:41,212 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,212 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:41,212 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:41,215 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,215 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:41,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:41,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:41,215 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:41,215 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:41,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:41,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:41,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:41,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:41,222 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:41,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:41,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:41,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,223 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:41,229 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,229 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:41,229 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:41,230 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:41,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:41,234 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:41,240 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,240 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:41,240 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:41,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:41,240 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,241 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,241 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:41,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:41,241 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:41,241 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,242 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:41,242 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:41,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-30 16:53:41,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:41,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:41,342 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:41,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:41,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:41,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:41,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,366 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:41,366 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:41,370 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:41,370 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:41,371 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,372 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,373 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:41,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,375 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,377 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,382 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:41,382 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:41,388 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:41,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:41,388 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:41,388 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:41,389 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:41,389 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:41,390 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:41,390 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:41,390 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:41,390 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:41,880 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e51d72451f3841e1bf1e87215ad648b2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e51d72451f3841e1bf1e87215ad648b2 2023-03-30 16:53:42,305 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/45fe8ef3cc7d4644b322e582d53c561e 2023-03-30 16:53:42,317 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/45fe8ef3cc7d4644b322e582d53c561e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/45fe8ef3cc7d4644b322e582d53c561e 2023-03-30 16:53:42,318 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-30 16:53:42,321 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-30 16:53:42,332 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/45fe8ef3cc7d4644b322e582d53c561e, entries=1, sequenceid=13, filesize=5.0 K 2023-03-30 16:53:42,334 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 944ms, sequenceid=13, compaction requested=true 2023-03-30 16:53:42,334 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:42,334 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:42,334 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:42,334 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:42,334 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,335 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:42,335 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:42,338 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,338 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:42,339 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,339 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:42,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:42,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:42,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:42,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ea1a158[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:42,341 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:42,342 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,344 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,344 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:42,344 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:42,344 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:42,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:42,350 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:42,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:42,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:42,359 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:42,360 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:42,360 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:42,360 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,360 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:42,362 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,362 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:42,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,362 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:42,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:42,363 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:42,365 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:42,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:42,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:42,375 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:42,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:42,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:42,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:42,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,376 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,376 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:42,376 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:42,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-30 16:53:42,476 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:42,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:42,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:42,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:42,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,497 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:42,497 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:42,498 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:42,498 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:42,498 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,498 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,500 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:42,500 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:42,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:42,500 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,501 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:42,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:42,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,503 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:42,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,503 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:42,503 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:42,511 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:42,511 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:42,511 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:42,511 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:42,512 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:42,700 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c754fb375a414416b5aabf3e43c7bb24 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c754fb375a414416b5aabf3e43c7bb24 2023-03-30 16:53:42,718 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/c53a51f420934244a850189a73732218 2023-03-30 16:53:42,732 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/c53a51f420934244a850189a73732218 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/c53a51f420934244a850189a73732218 2023-03-30 16:53:42,742 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/c53a51f420934244a850189a73732218, entries=1, sequenceid=17, filesize=5.0 K 2023-03-30 16:53:42,744 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 232ms, sequenceid=17, compaction requested=true 2023-03-30 16:53:42,744 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:42,744 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:42,744 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:42,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:42,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:42,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:42,747 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:42,750 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,750 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:42,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:42,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:42,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:42,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:42,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d00a2b8[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:42,753 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:42,753 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,754 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:42,755 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,755 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:42,758 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:42,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:42,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:42,770 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:42,770 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:42,770 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:42,770 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,770 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:42,773 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,773 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:42,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:42,774 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:42,776 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:42,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,780 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,789 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:42,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:42,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:42,790 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:42,794 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:42,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:42,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,799 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:42,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:42,899 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:42,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:42,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:42,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:42,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,920 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:42,920 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:42,921 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:42,921 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:42,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,925 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:42,925 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:42,925 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:42,925 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:42,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:42,926 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:42,927 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:42,927 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:42,927 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:42,927 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:42,927 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:42,927 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:42,927 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:43,188 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:53:43,297 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-30 16:53:43,297 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-30 16:53:43,369 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281809be363e58419db0d4e8bad9553d39 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281809be363e58419db0d4e8bad9553d39 2023-03-30 16:53:43,809 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/122c3705d17b41f0b5632f0c04560a74 2023-03-30 16:53:43,820 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/122c3705d17b41f0b5632f0c04560a74 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/122c3705d17b41f0b5632f0c04560a74 2023-03-30 16:53:43,833 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/122c3705d17b41f0b5632f0c04560a74, entries=1, sequenceid=21, filesize=5.0 K 2023-03-30 16:53:43,835 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 908ms, sequenceid=21, compaction requested=true 2023-03-30 16:53:43,835 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:43,836 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:43,836 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:43,836 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:43,836 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,836 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:43,836 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:43,842 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,842 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:43,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:43,842 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,842 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:43,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:43,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:43,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:43,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:43,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20b19d9c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:43,845 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:43,845 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,847 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:43,847 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,847 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:43,849 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:43,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:43,853 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:43,853 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:43,853 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:43,853 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,853 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:43,856 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,856 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,857 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:43,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,857 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:43,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,859 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,862 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,862 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,862 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,862 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:43,862 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:43,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:43,863 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:43,863 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,863 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:43,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:43,863 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:43,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:43,864 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:43,864 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:43,863 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:43,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-30 16:53:43,964 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:43,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:43,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:44,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:44,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,000 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:44,001 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:44,001 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:44,001 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:44,002 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,002 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,003 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,003 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:44,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:44,003 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,004 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,005 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,005 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:44,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:44,006 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:44,006 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:44,006 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:44,006 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:44,006 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:44,006 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:44,448 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313eb062a5d0cd4c36adcece2da4909f87 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313eb062a5d0cd4c36adcece2da4909f87 2023-03-30 16:53:44,464 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/eae370160fbb4b42910223335ff280f5 2023-03-30 16:53:44,474 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/eae370160fbb4b42910223335ff280f5 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/eae370160fbb4b42910223335ff280f5 2023-03-30 16:53:44,497 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/eae370160fbb4b42910223335ff280f5, entries=1, sequenceid=25, filesize=5.0 K 2023-03-30 16:53:44,499 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 493ms, sequenceid=25, compaction requested=true 2023-03-30 16:53:44,499 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:44,499 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:44,502 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:44,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:44,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b4b96c0[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:44,505 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:44,505 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,507 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:44,508 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,509 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:44,509 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,509 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:44,509 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:44,509 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:44,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:44,514 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:44,514 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:44,514 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:44,514 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,514 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:44,525 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,525 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:44,525 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:44,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,527 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,529 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:44,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,533 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:44,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:44,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:44,534 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,535 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,535 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,535 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:44,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:44,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:44,536 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:44,536 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:44,636 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:44,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:44,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:44,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:44,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,651 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:44,651 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:44,651 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:44,651 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:44,652 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,652 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,654 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:44,654 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:44,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:44,655 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:44,655 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,656 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:44,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:44,656 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:44,656 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:44,657 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:44,657 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:44,657 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:44,657 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:44,657 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:44,657 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:44,690 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101cb682b9cc6f04c61b9607bc165d34271 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101cb682b9cc6f04c61b9607bc165d34271 2023-03-30 16:53:45,134 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/bffa2b0c35d14f2b879b5dd49393747d 2023-03-30 16:53:45,144 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/bffa2b0c35d14f2b879b5dd49393747d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/bffa2b0c35d14f2b879b5dd49393747d 2023-03-30 16:53:45,155 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/bffa2b0c35d14f2b879b5dd49393747d, entries=1, sequenceid=29, filesize=5.0 K 2023-03-30 16:53:45,156 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 499ms, sequenceid=29, compaction requested=true 2023-03-30 16:53:45,156 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:45,157 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:45,157 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:45,160 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:45,160 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,160 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:45,160 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:45,163 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,163 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:45,164 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,164 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:45,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:45,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:45,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:45,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:45,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28b34390[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:45,167 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:45,167 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,168 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,168 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:45,169 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:45,169 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:45,169 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,169 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:45,171 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:45,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:45,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:45,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:45,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:45,176 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:45,176 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:45,176 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:45,176 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,176 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:45,178 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,178 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:45,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,178 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:45,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:45,179 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,180 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,191 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,192 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:45,192 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,192 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,192 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:45,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:45,192 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,192 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:45,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:45,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-30 16:53:45,192 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:45,193 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:45,193 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:45,194 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:45,194 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:45,294 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:45,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:45,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:45,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:45,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,307 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:45,307 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:45,307 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:45,308 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:45,308 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,308 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,309 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,309 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:45,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:45,310 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,310 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:45,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,312 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:45,312 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:45,312 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:45,312 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:45,312 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:45,312 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:45,313 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:45,313 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:45,743 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010382812ab2872b4d95b063344a4f98de5f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010382812ab2872b4d95b063344a4f98de5f 2023-03-30 16:53:45,772 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/9ad7a4a022ed4c968a180b2b30764521 2023-03-30 16:53:45,784 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/9ad7a4a022ed4c968a180b2b30764521 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/9ad7a4a022ed4c968a180b2b30764521 2023-03-30 16:53:45,795 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/9ad7a4a022ed4c968a180b2b30764521, entries=1, sequenceid=33, filesize=5.0 K 2023-03-30 16:53:45,797 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 484ms, sequenceid=33, compaction requested=true 2023-03-30 16:53:45,797 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:45,798 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:45,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:45,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:45,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:45,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:45,800 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,800 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:45,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:45,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40ce215c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:45,804 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:45,804 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,806 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,806 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:45,806 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:45,806 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:45,806 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,806 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:45,808 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:45,808 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,808 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:45,808 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:45,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:45,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:45,812 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:45,812 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:45,812 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:45,812 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,812 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:45,815 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,815 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:45,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:45,816 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,817 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,818 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:45,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:45,821 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:45,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:45,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:45,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:45,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:45,822 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,822 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,822 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,822 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:45,823 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:45,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:45,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-30 16:53:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:45,923 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:45,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:45,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:45,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:45,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,936 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:45,936 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:45,937 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:45,937 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:45,937 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,937 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,939 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,939 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:45,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:45,939 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:45,939 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,941 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:45,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:45,949 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:45,950 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:45,950 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:45,950 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:45,950 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:45,950 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:46,099 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077470a8ffc6414237960c52cc1064f467 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509077470a8ffc6414237960c52cc1064f467 2023-03-30 16:53:46,525 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/e85418e4af2c4563954bae2583cfc1f5 2023-03-30 16:53:46,536 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/e85418e4af2c4563954bae2583cfc1f5 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/e85418e4af2c4563954bae2583cfc1f5 2023-03-30 16:53:46,560 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/e85418e4af2c4563954bae2583cfc1f5, entries=1, sequenceid=37, filesize=5.0 K 2023-03-30 16:53:46,561 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 611ms, sequenceid=37, compaction requested=true 2023-03-30 16:53:46,561 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:46,561 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:46,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:46,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cbf19a4[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:46,568 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:46,568 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,569 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,569 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:46,569 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:46,569 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:46,569 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,569 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:46,571 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,571 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:46,571 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:46,571 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:46,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:46,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:46,577 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:46,577 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:46,577 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:46,577 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,577 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:46,579 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,579 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:46,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,580 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:46,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:46,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,581 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:46,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,586 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:46,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:46,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-30 16:53:46,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:46,592 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:46,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,593 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:46,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:46,594 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:46,594 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:46,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:46,695 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:46,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:46,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:46,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:46,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,708 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:46,708 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:46,709 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-30 16:53:46,709 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-30 16:53:46,710 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,710 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,711 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:46,711 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:46,712 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:46,712 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,713 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-30 16:53:46,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-30 16:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-30 16:53:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:46,715 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:46,715 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. started... 2023-03-30 16:53:46,716 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 530b2a08fdec00a887d0a81479c49486 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:46,745 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120acd633ce8993409c9d98561f19db6300 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120acd633ce8993409c9d98561f19db6300 2023-03-30 16:53:47,159 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/f6d348f0470f4795b767a2751a0473a0 2023-03-30 16:53:47,168 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/f6d348f0470f4795b767a2751a0473a0 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/f6d348f0470f4795b767a2751a0473a0 2023-03-30 16:53:47,176 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/f6d348f0470f4795b767a2751a0473a0, entries=1, sequenceid=41, filesize=5.0 K 2023-03-30 16:53:47,178 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 530b2a08fdec00a887d0a81479c49486 in 462ms, sequenceid=41, compaction requested=true 2023-03-30 16:53:47,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:47,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-30 16:53:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-30 16:53:47,181 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,181 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:47,181 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,181 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:47,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-30 16:53:47,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4be56f65[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:47,183 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-30 16:53:47,183 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,185 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,185 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,185 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-30 16:53:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-30 16:53:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:47,191 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,191 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-30 16:53:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:47,191 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:47,191 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-30 16:53:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:47,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-30 16:53:47,196 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-30 16:53:47,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:47,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:47,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,196 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:47,198 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,198 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,198 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:47,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,200 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,209 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:47,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,212 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,212 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,212 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:47,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-30 16:53:47,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:47,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:47,212 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:47,212 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,212 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:47,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:47,213 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:47,213 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,213 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,213 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,213 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:47,213 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:47,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:47,313 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:47,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:47,321 DEBUG [Listener at localhost/41799] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-30 16:53:47,324 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-30 16:53:47,326 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:47,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-30 16:53:47,344 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-30 16:53:47,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:53:47,346 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195827346 2023-03-30 16:53:47,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:53:47,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-30 16:53:47,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:47,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x483ac863 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:53:47,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27ad4f76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:53:47,370 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:47,959 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010302eb609f4a5f4ddb9913f1f3817ef3d2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010302eb609f4a5f4ddb9913f1f3817ef3d2 2023-03-30 16:53:47,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:47,989 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:53:47,991 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41308, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:53:48,006 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:53:48,008 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:53:48,069 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceeb2840e2374024986d43ef372a8c7d first=Optional[r3] last=Optional[r6] 2023-03-30 16:53:48,085 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceeb2840e2374024986d43ef372a8c7d}] 2023-03-30 16:53:48,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceeb2840e2374024986d43ef372a8c7d for inclusion in 530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:48,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-30 16:53:48,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:53:48,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:48,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceeb2840e2374024986d43ef372a8c7d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j4abalr64f0pam7t8eosisuvhs5r2nbm10l0ilnuo7u3vvsq2p4dbd5jqph32c2k/family1/ceeb2840e2374024986d43ef372a8c7d 2023-03-30 16:53:48,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j4abalr64f0pam7t8eosisuvhs5r2nbm10l0ilnuo7u3vvsq2p4dbd5jqph32c2k/family1/ceeb2840e2374024986d43ef372a8c7d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_ 2023-03-30 16:53:48,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j4abalr64f0pam7t8eosisuvhs5r2nbm10l0ilnuo7u3vvsq2p4dbd5jqph32c2k/family1/ceeb2840e2374024986d43ef372a8c7d into 530b2a08fdec00a887d0a81479c49486/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_ - updating store file list. 2023-03-30 16:53:48,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_ into 530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:48,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j4abalr64f0pam7t8eosisuvhs5r2nbm10l0ilnuo7u3vvsq2p4dbd5jqph32c2k/family1/ceeb2840e2374024986d43ef372a8c7d into 530b2a08fdec00a887d0a81479c49486/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_) 2023-03-30 16:53:48,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j4abalr64f0pam7t8eosisuvhs5r2nbm10l0ilnuo7u3vvsq2p4dbd5jqph32c2k/family1/ceeb2840e2374024986d43ef372a8c7d 2023-03-30 16:53:48,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-30 16:53:48,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-30 16:53:48,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): 530b2a08fdec00a887d0a81479c49486/family1 is initiating minor compaction 2023-03-30 16:53:48,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@672d3996; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:48,160 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 530b2a08fdec00a887d0a81479c49486/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:48,161 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/edfe2cde472244f5907452c1a638d720, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/45fe8ef3cc7d4644b322e582d53c561e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/c53a51f420934244a850189a73732218, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/122c3705d17b41f0b5632f0c04560a74, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/eae370160fbb4b42910223335ff280f5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/bffa2b0c35d14f2b879b5dd49393747d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/9ad7a4a022ed4c968a180b2b30764521, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/e85418e4af2c4563954bae2583cfc1f5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/f6d348f0470f4795b767a2751a0473a0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp, totalSize=50.2 K 2023-03-30 16:53:48,162 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting edfe2cde472244f5907452c1a638d720, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:53:48,162 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 45fe8ef3cc7d4644b322e582d53c561e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:53:48,162 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting c53a51f420934244a850189a73732218, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-30 16:53:48,162 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 122c3705d17b41f0b5632f0c04560a74, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-30 16:53:48,162 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting eae370160fbb4b42910223335ff280f5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-30 16:53:48,163 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting bffa2b0c35d14f2b879b5dd49393747d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-30 16:53:48,163 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 9ad7a4a022ed4c968a180b2b30764521, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-30 16:53:48,163 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting e85418e4af2c4563954bae2583cfc1f5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-30 16:53:48,163 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting f6d348f0470f4795b767a2751a0473a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-30 16:53:48,163 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-30 16:53:48,188 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:48,191 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:48,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281809be363e58419db0d4e8bad9553d39 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281809be363e58419db0d4e8bad9553d39 2023-03-30 16:53:48,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313eb062a5d0cd4c36adcece2da4909f87 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313eb062a5d0cd4c36adcece2da4909f87 2023-03-30 16:53:48,209 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101cb682b9cc6f04c61b9607bc165d34271 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101cb682b9cc6f04c61b9607bc165d34271 2023-03-30 16:53:48,213 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010382812ab2872b4d95b063344a4f98de5f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010382812ab2872b4d95b063344a4f98de5f 2023-03-30 16:53:48,213 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-30 16:53:48,213 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-30 16:53:48,214 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,214 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,214 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,268 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 530b2a08fdec00a887d0a81479c49486#family1#compaction#10 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:53:48,321 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/84a0258a95654d0cb692fc76291a45fd as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/84a0258a95654d0cb692fc76291a45fd 2023-03-30 16:53:48,368 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 530b2a08fdec00a887d0a81479c49486/family1 of 530b2a08fdec00a887d0a81479c49486 into 84a0258a95654d0cb692fc76291a45fd(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:53:48,368 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:48,370 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1680195228155; duration=0sec 2023-03-30 16:53:48,371 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:48,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/edfe2cde472244f5907452c1a638d720, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/45fe8ef3cc7d4644b322e582d53c561e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/c53a51f420934244a850189a73732218, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/122c3705d17b41f0b5632f0c04560a74, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/eae370160fbb4b42910223335ff280f5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/bffa2b0c35d14f2b879b5dd49393747d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/9ad7a4a022ed4c968a180b2b30764521, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/e85418e4af2c4563954bae2583cfc1f5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/f6d348f0470f4795b767a2751a0473a0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_] to archive 2023-03-30 16:53:48,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:48,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/edfe2cde472244f5907452c1a638d720 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/edfe2cde472244f5907452c1a638d720 2023-03-30 16:53:48,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/45fe8ef3cc7d4644b322e582d53c561e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/45fe8ef3cc7d4644b322e582d53c561e 2023-03-30 16:53:48,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/c53a51f420934244a850189a73732218 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/c53a51f420934244a850189a73732218 2023-03-30 16:53:48,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/122c3705d17b41f0b5632f0c04560a74 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/122c3705d17b41f0b5632f0c04560a74 2023-03-30 16:53:48,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/eae370160fbb4b42910223335ff280f5 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/eae370160fbb4b42910223335ff280f5 2023-03-30 16:53:48,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/bffa2b0c35d14f2b879b5dd49393747d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/bffa2b0c35d14f2b879b5dd49393747d 2023-03-30 16:53:48,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/9ad7a4a022ed4c968a180b2b30764521 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/9ad7a4a022ed4c968a180b2b30764521 2023-03-30 16:53:48,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/e85418e4af2c4563954bae2583cfc1f5 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/e85418e4af2c4563954bae2583cfc1f5 2023-03-30 16:53:48,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/f6d348f0470f4795b767a2751a0473a0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/f6d348f0470f4795b767a2751a0473a0 2023-03-30 16:53:48,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/1fffcb624aa349c4bbdfa33fc529e05d_SeqId_44_ 2023-03-30 16:53:48,441 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205090b1cf148024706a39a97bbfa0d88ce to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205090b1cf148024706a39a97bbfa0d88ce 2023-03-30 16:53:48,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:48,506 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fb49b3b1806a48848becad6d0e8cc75d first=Optional[r00] last=Optional[r2] 2023-03-30 16:53:48,509 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fb49b3b1806a48848becad6d0e8cc75d}] 2023-03-30 16:53:48,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fb49b3b1806a48848becad6d0e8cc75d for inclusion in 530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:48,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-30 16:53:48,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:53:48,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:48,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fb49b3b1806a48848becad6d0e8cc75d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gccd7is2ti8552fd2873me8563k7o9j38js9igtlds12lbdajmnn4dhem09mi0ka/family1/fb49b3b1806a48848becad6d0e8cc75d 2023-03-30 16:53:48,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gccd7is2ti8552fd2873me8563k7o9j38js9igtlds12lbdajmnn4dhem09mi0ka/family1/fb49b3b1806a48848becad6d0e8cc75d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_ 2023-03-30 16:53:48,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gccd7is2ti8552fd2873me8563k7o9j38js9igtlds12lbdajmnn4dhem09mi0ka/family1/fb49b3b1806a48848becad6d0e8cc75d into 530b2a08fdec00a887d0a81479c49486/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_ - updating store file list. 2023-03-30 16:53:48,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_ into 530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:48,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gccd7is2ti8552fd2873me8563k7o9j38js9igtlds12lbdajmnn4dhem09mi0ka/family1/fb49b3b1806a48848becad6d0e8cc75d into 530b2a08fdec00a887d0a81479c49486/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_) 2023-03-30 16:53:48,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gccd7is2ti8552fd2873me8563k7o9j38js9igtlds12lbdajmnn4dhem09mi0ka/family1/fb49b3b1806a48848becad6d0e8cc75d 2023-03-30 16:53:48,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-30 16:53:48,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-30 16:53:48,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): 530b2a08fdec00a887d0a81479c49486/family1 is initiating minor compaction (all files) 2023-03-30 16:53:48,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6cae9426; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:48,545 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 530b2a08fdec00a887d0a81479c49486/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:48,546 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/60d269bcdb894736b283e53eb143162e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/84a0258a95654d0cb692fc76291a45fd, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp, totalSize=358.6 K 2023-03-30 16:53:48,547 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 60d269bcdb894736b283e53eb143162e, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839396 2023-03-30 16:53:48,547 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 84a0258a95654d0cb692fc76291a45fd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239396 2023-03-30 16:53:48,548 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839396 2023-03-30 16:53:48,550 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:48,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:48,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b9d3d87664b943cc8b3e1c5236fc3a7e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b9d3d87664b943cc8b3e1c5236fc3a7e 2023-03-30 16:53:48,560 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e51d72451f3841e1bf1e87215ad648b2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e51d72451f3841e1bf1e87215ad648b2 2023-03-30 16:53:48,562 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c754fb375a414416b5aabf3e43c7bb24 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c754fb375a414416b5aabf3e43c7bb24 2023-03-30 16:53:48,562 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-30 16:53:48,562 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-30 16:53:48,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:48,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:48,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:53:48,565 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-30 16:53:48,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.2320 sec 2023-03-30 16:53:48,615 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 530b2a08fdec00a887d0a81479c49486#family1#compaction#11 average throughput is 3.84 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:53:48,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-30 16:53:48,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:48,909 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-30 16:53:48,911 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-30 16:53:48,911 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-30 16:53:48,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-30 16:53:48,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, REOPEN/MOVE}] 2023-03-30 16:53:48,939 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, REOPEN/MOVE 2023-03-30 16:53:48,941 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=530b2a08fdec00a887d0a81479c49486, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:48,941 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680195228941"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195228941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195228941"}]},"ts":"1680195228941"} 2023-03-30 16:53:48,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 530b2a08fdec00a887d0a81479c49486, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:53:49,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 530b2a08fdec00a887d0a81479c49486, disabling compactions & flushes 2023-03-30 16:53:49,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,123 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/.tmp/family1/ae8980b12e3842adb931904d9f62ad7a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/ae8980b12e3842adb931904d9f62ad7a 2023-03-30 16:53:49,132 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 530b2a08fdec00a887d0a81479c49486/family1 of 530b2a08fdec00a887d0a81479c49486 into ae8980b12e3842adb931904d9f62ad7a(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:53:49,132 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:49,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,134 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1680195228545; duration=0sec 2023-03-30 16:53:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,134 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. after waiting 0 ms 2023-03-30 16:53:49,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,138 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/60d269bcdb894736b283e53eb143162e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/84a0258a95654d0cb692fc76291a45fd, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_] to archive 2023-03-30 16:53:49,139 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:49,142 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/60d269bcdb894736b283e53eb143162e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/60d269bcdb894736b283e53eb143162e 2023-03-30 16:53:49,144 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/84a0258a95654d0cb692fc76291a45fd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/84a0258a95654d0cb692fc76291a45fd 2023-03-30 16:53:49,147 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/0458ba2c02b842e8a1664ef24cbb4ff8_SeqId_47_ 2023-03-30 16:53:49,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-30 16:53:49,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:49,162 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 530b2a08fdec00a887d0a81479c49486 to self. 2023-03-30 16:53:49,166 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=530b2a08fdec00a887d0a81479c49486, regionState=CLOSED 2023-03-30 16:53:49,166 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680195229166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195229166"}]},"ts":"1680195229166"} 2023-03-30 16:53:49,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-30 16:53:49,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 530b2a08fdec00a887d0a81479c49486, server=jenkins-hbase4.apache.org,39029,1680195214375 in 225 msec 2023-03-30 16:53:49,173 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=true 2023-03-30 16:53:49,323 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=530b2a08fdec00a887d0a81479c49486, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:49,324 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680195229323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195229323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195229323"}]},"ts":"1680195229323"} 2023-03-30 16:53:49,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 530b2a08fdec00a887d0a81479c49486, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:53:49,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 530b2a08fdec00a887d0a81479c49486, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:53:49,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:49,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,487 INFO [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,488 DEBUG [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:49,488 DEBUG [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:49,489 INFO [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 530b2a08fdec00a887d0a81479c49486 columnFamilyName family1 2023-03-30 16:53:49,497 DEBUG [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/ae8980b12e3842adb931904d9f62ad7a 2023-03-30 16:53:49,498 INFO [StoreOpener-530b2a08fdec00a887d0a81479c49486-1] regionserver.HStore(310): Store=530b2a08fdec00a887d0a81479c49486/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:49,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:53:49,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 530b2a08fdec00a887d0a81479c49486; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73188249, jitterRate=0.09058989584445953}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:53:49,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:49,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486., pid=17, masterSystemTime=1680195229480 2023-03-30 16:53:49,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:53:49,513 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=530b2a08fdec00a887d0a81479c49486, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:49,513 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680195229513"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195229513"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195229513"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195229513"}]},"ts":"1680195229513"} 2023-03-30 16:53:49,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-30 16:53:49,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 530b2a08fdec00a887d0a81479c49486, server=jenkins-hbase4.apache.org,39029,1680195214375 in 188 msec 2023-03-30 16:53:49,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-30 16:53:49,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=530b2a08fdec00a887d0a81479c49486, REOPEN/MOVE in 581 msec 2023-03-30 16:53:49,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-30 16:53:49,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 606 msec 2023-03-30 16:53:49,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 665 msec 2023-03-30 16:53:49,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-30 16:53:49,541 INFO [Listener at localhost/41799] compactions.TestMobCompactor(278): alter status finished 2023-03-30 16:53:49,542 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-30 16:53:49,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-30 16:53:49,552 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-30 16:53:49,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:53:49,554 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195829554 2023-03-30 16:53:49,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:53:49,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-30 16:53:49,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:49,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x6492ee74 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:53:49,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b39a4e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:53:49,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:49,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:49,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:49,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:49,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:50,022 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f4c33797d68448a78ba36b0752c1fbed to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f4c33797d68448a78ba36b0752c1fbed 2023-03-30 16:53:50,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:50,042 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:53:50,044 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:53:50,054 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:53:50,056 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40280, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:53:50,072 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b9a7022b967949258acc70a06f9eda97 first=Optional[r05] last=Optional[r8] 2023-03-30 16:53:50,073 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=51 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b9a7022b967949258acc70a06f9eda97}] 2023-03-30 16:53:50,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b9a7022b967949258acc70a06f9eda97 for inclusion in 530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-30 16:53:50,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:53:50,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:53:50,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b9a7022b967949258acc70a06f9eda97 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__67onvlk1l3fn3je6cl4i1t1apqm9bpdh7kemnt50gqqlbf5qdg95ho9fibhmn6hs/family1/b9a7022b967949258acc70a06f9eda97 2023-03-30 16:53:50,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__67onvlk1l3fn3je6cl4i1t1apqm9bpdh7kemnt50gqqlbf5qdg95ho9fibhmn6hs/family1/b9a7022b967949258acc70a06f9eda97 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/7c153910c7b04611bb0607d891d0f89e_SeqId_53_ 2023-03-30 16:53:50,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__67onvlk1l3fn3je6cl4i1t1apqm9bpdh7kemnt50gqqlbf5qdg95ho9fibhmn6hs/family1/b9a7022b967949258acc70a06f9eda97 into 530b2a08fdec00a887d0a81479c49486/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/7c153910c7b04611bb0607d891d0f89e_SeqId_53_ - updating store file list. 2023-03-30 16:53:50,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/7c153910c7b04611bb0607d891d0f89e_SeqId_53_ into 530b2a08fdec00a887d0a81479c49486/family1 2023-03-30 16:53:50,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__67onvlk1l3fn3je6cl4i1t1apqm9bpdh7kemnt50gqqlbf5qdg95ho9fibhmn6hs/family1/b9a7022b967949258acc70a06f9eda97 into 530b2a08fdec00a887d0a81479c49486/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/family1/7c153910c7b04611bb0607d891d0f89e_SeqId_53_) 2023-03-30 16:53:50,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__67onvlk1l3fn3je6cl4i1t1apqm9bpdh7kemnt50gqqlbf5qdg95ho9fibhmn6hs/family1/b9a7022b967949258acc70a06f9eda97 2023-03-30 16:53:50,106 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:50,107 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:50,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120acd633ce8993409c9d98561f19db6300 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120acd633ce8993409c9d98561f19db6300 2023-03-30 16:53:50,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f0ed6c9756ea4560acda3bd768872fc7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f0ed6c9756ea4560acda3bd768872fc7 2023-03-30 16:53:50,112 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-30 16:53:50,112 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-30 16:53:50,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:50,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:50,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-30 16:53:50,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-30 16:53:50,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:53:50,114 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-30 16:53:50,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 572 msec 2023-03-30 16:53:50,234 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=251 (was 210) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56000 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56058 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x6492ee74 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1719445576.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:55970 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:55934 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56206 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x87062c4-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56180 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56194 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x483ac863 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1719445576.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x87062c4-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:39029-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x6492ee74-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x87062c4-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4cc10cf9-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x6492ee74-SendThread(127.0.0.1:64100) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56094 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56084 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56090 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4cc10cf9-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x87062c4-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56164 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1748105607_15 at /127.0.0.1:56220 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x483ac863-SendThread(127.0.0.1:64100) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56042 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56196 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4cc10cf9-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56074 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x483ac863-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x87062c4-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56266 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=593 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=422 (was 307) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=5029 (was 5388) 2023-03-30 16:53:50,251 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=422, ProcessCount=169, AvailableMemoryMB=5027 2023-03-30 16:53:50,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-30 16:53:50,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:53:50,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-30 16:53:50,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:53:50,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-30 16:53:50,265 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,266 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817 empty. 2023-03-30 16:53:50,267 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,267 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-30 16:53:50,281 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-30 16:53:50,285 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f8da1b06ca1f9816201b026631e89817, NAME => 'testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:53:50,300 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:50,300 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing f8da1b06ca1f9816201b026631e89817, disabling compactions & flushes 2023-03-30 16:53:50,300 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,301 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,301 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. after waiting 0 ms 2023-03-30 16:53:50,301 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,301 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,301 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:50,304 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:53:50,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680195230305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195230305"}]},"ts":"1680195230305"} 2023-03-30 16:53:50,308 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:53:50,309 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:53:50,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195230309"}]},"ts":"1680195230309"} 2023-03-30 16:53:50,311 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-30 16:53:50,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f8da1b06ca1f9816201b026631e89817, ASSIGN}] 2023-03-30 16:53:50,317 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f8da1b06ca1f9816201b026631e89817, ASSIGN 2023-03-30 16:53:50,318 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f8da1b06ca1f9816201b026631e89817, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:53:50,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-30 16:53:50,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f8da1b06ca1f9816201b026631e89817, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:50,470 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680195230469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195230469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195230469"}]},"ts":"1680195230469"} 2023-03-30 16:53:50,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure f8da1b06ca1f9816201b026631e89817, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:53:50,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-30 16:53:50,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8da1b06ca1f9816201b026631e89817, NAME => 'testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:53:50,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:50,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,632 INFO [StoreOpener-f8da1b06ca1f9816201b026631e89817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,633 DEBUG [StoreOpener-f8da1b06ca1f9816201b026631e89817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:50,633 DEBUG [StoreOpener-f8da1b06ca1f9816201b026631e89817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:50,634 INFO [StoreOpener-f8da1b06ca1f9816201b026631e89817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8da1b06ca1f9816201b026631e89817 columnFamilyName family1 2023-03-30 16:53:50,637 INFO [StoreOpener-f8da1b06ca1f9816201b026631e89817-1] regionserver.HStore(310): Store=f8da1b06ca1f9816201b026631e89817/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:50,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f8da1b06ca1f9816201b026631e89817 2023-03-30 16:53:50,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:53:50,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f8da1b06ca1f9816201b026631e89817; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71605291, jitterRate=0.06700198352336884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:53:50,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:50,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817., pid=21, masterSystemTime=1680195230625 2023-03-30 16:53:50,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f8da1b06ca1f9816201b026631e89817, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:50,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680195230650"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195230650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195230650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195230650"}]},"ts":"1680195230650"} 2023-03-30 16:53:50,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-30 16:53:50,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure f8da1b06ca1f9816201b026631e89817, server=jenkins-hbase4.apache.org,39029,1680195214375 in 184 msec 2023-03-30 16:53:50,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-30 16:53:50,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f8da1b06ca1f9816201b026631e89817, ASSIGN in 344 msec 2023-03-30 16:53:50,663 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:53:50,664 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195230663"}]},"ts":"1680195230663"} 2023-03-30 16:53:50,665 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-30 16:53:50,668 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:53:50,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 414 msec 2023-03-30 16:53:50,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-30 16:53:50,867 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-30 16:53:50,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:50,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,927 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:50,927 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:50,927 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:50,928 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:50,928 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,928 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,930 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:50,930 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:50,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:50,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:50,930 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:50,930 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:50,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:50,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,931 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:50,932 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:50,940 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:50,940 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:50,940 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:50,940 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:50,941 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-30 16:53:50,997 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a135d0d395e44ca893b56fb5192377d0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a135d0d395e44ca893b56fb5192377d0 2023-03-30 16:53:51,404 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/d93d036e10614f8fa7c3504b9fc93813 2023-03-30 16:53:51,413 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/d93d036e10614f8fa7c3504b9fc93813 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/d93d036e10614f8fa7c3504b9fc93813 2023-03-30 16:53:51,424 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/d93d036e10614f8fa7c3504b9fc93813, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-30 16:53:51,426 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 485ms, sequenceid=5, compaction requested=false 2023-03-30 16:53:51,426 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:51,427 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:51,427 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:51,427 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:51,427 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:51,427 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,427 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:51,427 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:51,429 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,430 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,430 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,430 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:51,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79780a4a[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:51,438 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:51,438 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,440 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:51,442 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:51,442 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:51,442 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,442 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:51,443 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:51,443 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:51,443 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:51,443 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:51,444 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:51,444 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,444 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:51,446 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,447 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,449 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,449 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,449 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:51,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:51,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:51,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,454 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:51,454 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:51,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:51,454 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:51,454 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,454 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:51,454 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,455 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,455 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:51,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:51,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:51,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:51,455 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,455 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,456 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:51,456 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:51,556 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:51,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:51,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:51,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:51,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,570 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:51,570 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:51,571 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:51,571 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:51,571 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,571 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,573 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,573 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:51,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:51,573 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,573 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:51,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:51,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,574 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,575 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:51,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:51,576 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:51,576 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:51,576 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:51,576 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:51,576 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:51,576 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-30 16:53:51,602 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c5d1f3e1b635456c8571c6e250e7f800 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5d1f3e1b635456c8571c6e250e7f800 2023-03-30 16:53:51,611 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec 2023-03-30 16:53:51,619 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec 2023-03-30 16:53:51,629 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec, entries=1, sequenceid=9, filesize=5.0 K 2023-03-30 16:53:51,630 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 54ms, sequenceid=9, compaction requested=false 2023-03-30 16:53:51,631 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:51,631 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:51,631 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:51,631 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:51,631 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,632 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:51,632 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:51,633 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,633 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:51,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@480d00f8[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:51,636 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:51,636 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,637 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,638 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:51,638 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:51,638 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:51,638 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,638 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:51,639 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,639 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:51,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:51,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:51,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:51,646 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:51,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:51,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:51,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,646 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:51,648 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,648 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:51,648 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,650 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,651 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:51,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:51,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:51,662 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:51,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:51,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:51,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:51,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:51,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:51,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,663 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,663 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,663 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,663 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:51,664 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:51,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:51,764 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:51,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:51,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:51,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:51,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,775 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:51,775 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:51,776 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:51,776 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:51,776 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,776 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,778 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,778 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:51,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:51,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:51,778 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,778 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:51,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,779 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,780 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:51,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:51,784 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:51,784 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:51,785 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:51,785 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:51,785 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:51,785 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:51,859 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014d5b33052ef8411db81241870f47cf34 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014d5b33052ef8411db81241870f47cf34 2023-03-30 16:53:51,883 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/b96152d6d18c4b2fb52ce326f6454800 2023-03-30 16:53:51,894 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/b96152d6d18c4b2fb52ce326f6454800 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b96152d6d18c4b2fb52ce326f6454800 2023-03-30 16:53:51,906 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b96152d6d18c4b2fb52ce326f6454800, entries=1, sequenceid=13, filesize=4.9 K 2023-03-30 16:53:51,907 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 122ms, sequenceid=13, compaction requested=true 2023-03-30 16:53:51,907 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:51,908 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:51,908 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:51,908 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:51,908 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,908 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:51,908 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:51,911 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,911 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,911 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,911 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:51,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c6b5264[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:51,914 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:51,914 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,915 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,915 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:51,915 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:51,915 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:51,916 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,916 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:51,917 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:51,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:51,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:51,922 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:51,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:51,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:51,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,922 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:51,924 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,924 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,924 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:51,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:51,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:51,925 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,927 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:51,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:51,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:51,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:51,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:51,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:51,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:51,931 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:51,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:51,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:51,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:51,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:51,932 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,932 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:51,932 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:51,932 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:52,033 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:52,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:52,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:52,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:52,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,044 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:52,044 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:52,044 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:52,045 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:52,045 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,045 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,046 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:52,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:52,047 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,047 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,048 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,048 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:52,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:52,049 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:52,053 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:52,054 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:52,054 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:52,054 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:52,487 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ffdaea925f8146ccba797ef3cc971302 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffdaea925f8146ccba797ef3cc971302 2023-03-30 16:53:52,519 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/9e7eb3b593164f9d86dcbbe1ed648375 2023-03-30 16:53:52,531 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/9e7eb3b593164f9d86dcbbe1ed648375 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/9e7eb3b593164f9d86dcbbe1ed648375 2023-03-30 16:53:52,540 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/9e7eb3b593164f9d86dcbbe1ed648375, entries=1, sequenceid=17, filesize=4.9 K 2023-03-30 16:53:52,542 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 488ms, sequenceid=17, compaction requested=true 2023-03-30 16:53:52,542 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:52,542 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:52,544 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,544 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:52,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:52,544 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,545 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:52,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:52,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c9590cb[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:52,546 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:52,547 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,549 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,549 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:52,549 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,549 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:52,549 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:52,549 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:52,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:52,562 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:52,563 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:52,563 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:52,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:52,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:52,569 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:52,569 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:52,569 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:52,569 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,569 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:52,585 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,586 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,586 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:52,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:52,592 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:52,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,594 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,625 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:52,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:52,626 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:52,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:52,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,626 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,626 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:52,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:52,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:52,627 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:52,627 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:52,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:52,727 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:52,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:52,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:52,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:52,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,745 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:52,745 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:52,746 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:52,746 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:52,747 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,747 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,762 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:52,762 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:52,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:52,763 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,763 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:52,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,765 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:52,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,765 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:52,765 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:52,767 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:52,767 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:52,767 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:52,796 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f54c769ff047455eb80ff78963f13a87 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f54c769ff047455eb80ff78963f13a87 2023-03-30 16:53:52,805 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/14fbd4936bce4c409dce5f558bb31e4a 2023-03-30 16:53:52,813 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/14fbd4936bce4c409dce5f558bb31e4a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/14fbd4936bce4c409dce5f558bb31e4a 2023-03-30 16:53:52,822 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/14fbd4936bce4c409dce5f558bb31e4a, entries=1, sequenceid=21, filesize=4.9 K 2023-03-30 16:53:52,824 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 57ms, sequenceid=21, compaction requested=true 2023-03-30 16:53:52,824 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:52,824 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:52,826 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,826 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:52,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:52,827 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:52,827 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:52,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:52,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:52,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:52,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@506f749[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:52,830 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:52,830 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,831 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:52,831 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:52,831 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:52,832 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,832 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:52,834 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:52,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:52,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:52,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:52,838 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:52,838 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:52,838 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:52,838 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,838 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:52,851 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,851 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:52,851 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:52,852 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,855 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,858 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:52,858 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:52,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:52,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:52,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:52,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:52,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:52,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,865 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:52,866 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:52,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:52,966 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:52,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:52,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:52,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:52,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,976 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:52,976 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:52,976 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:52,976 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:52,977 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,977 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,980 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,980 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:52,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:52,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:52,980 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:52,980 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:52,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,981 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:52,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:52,982 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:52,982 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:52,983 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:52,983 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:52,999 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231210248e8203d438ca5f7b3897527db7c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231210248e8203d438ca5f7b3897527db7c 2023-03-30 16:53:53,406 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/e77f37c92b514ac98f4345d81198fb22 2023-03-30 16:53:53,415 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/e77f37c92b514ac98f4345d81198fb22 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/e77f37c92b514ac98f4345d81198fb22 2023-03-30 16:53:53,422 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/e77f37c92b514ac98f4345d81198fb22, entries=1, sequenceid=25, filesize=4.9 K 2023-03-30 16:53:53,424 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 441ms, sequenceid=25, compaction requested=true 2023-03-30 16:53:53,424 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:53,424 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:53,424 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:53,424 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:53,424 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,424 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:53,424 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:53,426 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,426 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:53,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:53,427 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,427 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:53,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:53,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25ac3dd1[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:53,433 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:53,433 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,434 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:53,434 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,434 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:53,436 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:53,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:53,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:53,436 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:53,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:53,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:53,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:53,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:53,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:53,439 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:53,439 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:53,439 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:53,440 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,440 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:53,443 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,443 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:53,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,443 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,444 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,445 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,448 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,448 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:53,448 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,448 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:53,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:53,448 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:53,448 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:53,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:53,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:53,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:53,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:53,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:53,449 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:53,449 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:53,448 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,450 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,450 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,450 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,550 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:53,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:53,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:53,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:53,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,565 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:53,565 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:53,566 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:53,566 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:53,566 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,566 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,568 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,568 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:53,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:53,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:53,568 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,568 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:53,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,570 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,572 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:53,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:53,573 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:53,580 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:53,580 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:53,580 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:53,622 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014dcb1faab6b24a958b9b43ec6dcc717d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014dcb1faab6b24a958b9b43ec6dcc717d 2023-03-30 16:53:53,634 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/239bddd52d4a4f06b0c4611301418aa1 2023-03-30 16:53:53,642 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/239bddd52d4a4f06b0c4611301418aa1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/239bddd52d4a4f06b0c4611301418aa1 2023-03-30 16:53:53,648 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/239bddd52d4a4f06b0c4611301418aa1, entries=1, sequenceid=29, filesize=4.9 K 2023-03-30 16:53:53,649 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 69ms, sequenceid=29, compaction requested=true 2023-03-30 16:53:53,649 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:53,650 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:53,650 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:53,650 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:53,650 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,650 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:53,650 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:53,656 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,656 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:53,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:53,657 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,657 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:53,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:53,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:53,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:53,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23d2a372[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:53,659 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:53,659 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,660 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,660 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:53,660 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:53,660 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:53,660 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,660 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:53,662 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:53,662 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:53,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,662 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:53,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:53,666 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:53,666 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:53,666 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:53,666 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,666 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:53,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:53,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:53,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:53,669 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,671 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:53,675 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:53,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:53,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:53,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:53,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:53,677 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:53,677 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:53,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:53,777 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:53,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:53,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:53,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:53,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,792 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:53,792 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:53,792 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:53,792 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:53,793 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,793 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,794 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:53,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:53,795 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:53,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,795 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:53,795 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:53,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:53,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,798 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:53,798 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:53,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:53,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:53,798 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:53,799 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:53,799 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:53,799 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:54,226 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030d7c15a7f55848e886a25da23cb12944 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030d7c15a7f55848e886a25da23cb12944 2023-03-30 16:53:54,260 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/4928a1005de54589b2b11a9682b065de 2023-03-30 16:53:54,269 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/4928a1005de54589b2b11a9682b065de as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/4928a1005de54589b2b11a9682b065de 2023-03-30 16:53:54,277 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/4928a1005de54589b2b11a9682b065de, entries=1, sequenceid=33, filesize=4.9 K 2023-03-30 16:53:54,278 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 479ms, sequenceid=33, compaction requested=true 2023-03-30 16:53:54,279 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:54,279 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:54,279 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:54,279 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:54,279 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,279 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:54,279 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:54,281 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,281 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:54,281 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,281 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:54,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:54,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33d17c0b[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:54,283 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:54,283 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,286 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,287 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:54,287 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:54,287 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:54,287 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,287 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:54,292 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:54,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:54,298 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:54,298 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:54,298 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:54,298 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,298 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:54,302 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,302 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:54,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,302 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:54,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,303 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,306 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,309 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:54,309 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:54,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:54,309 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:54,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:54,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:54,309 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:54,310 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,310 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,310 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,310 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,310 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,310 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,311 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:54,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:54,311 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:54,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:54,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:54,411 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:54,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:54,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:54,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:54,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,421 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:54,421 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:54,421 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:54,421 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:54,422 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,422 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,424 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:54,424 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:54,425 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,425 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:54,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,426 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:54,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:54,428 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:54,428 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:54,428 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:54,747 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:53:54,855 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907369a22424ba145c88b9ac7357ad6c175 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907369a22424ba145c88b9ac7357ad6c175 2023-03-30 16:53:54,868 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/99041c16dab84b898c16821317a804ac 2023-03-30 16:53:54,878 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/99041c16dab84b898c16821317a804ac as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/99041c16dab84b898c16821317a804ac 2023-03-30 16:53:54,888 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/99041c16dab84b898c16821317a804ac, entries=1, sequenceid=37, filesize=4.9 K 2023-03-30 16:53:54,890 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 462ms, sequenceid=37, compaction requested=true 2023-03-30 16:53:54,890 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:54,890 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:54,890 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:54,890 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:54,890 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,890 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:54,890 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:54,892 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:54,892 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:54,893 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,893 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:54,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:54,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15f7987[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:54,898 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:54,898 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,899 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:54,900 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,900 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:54,902 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,902 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:54,902 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:54,902 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:54,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:54,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:54,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:54,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:54,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:54,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:54,906 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:54,906 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:54,906 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:54,906 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,906 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:54,909 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,910 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:54,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,910 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:54,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:54,911 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,913 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,917 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:54,917 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:54,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:54,917 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:54,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:54,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:54,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:54,918 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:54,919 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:54,923 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,923 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,923 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,923 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:54,923 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,923 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,923 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:54,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:55,019 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:55,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:55,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:55,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:53:55,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,031 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:55,031 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:55,032 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:53:55,033 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:55,033 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,033 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,035 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:55,035 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:55,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:55,035 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,035 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:55,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:53:55,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,037 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:53:55,037 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:55,038 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:53:55,039 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:55,039 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:55,039 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:55,039 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. started... 2023-03-30 16:53:55,039 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8da1b06ca1f9816201b026631e89817 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:53:55,468 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bdd5e2a3ac9a451d9e64aed538f2478b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bdd5e2a3ac9a451d9e64aed538f2478b 2023-03-30 16:53:55,474 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/766b1f0ab13844a39d8db5ec06af71c0 2023-03-30 16:53:55,481 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/766b1f0ab13844a39d8db5ec06af71c0 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/766b1f0ab13844a39d8db5ec06af71c0 2023-03-30 16:53:55,491 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/766b1f0ab13844a39d8db5ec06af71c0, entries=1, sequenceid=41, filesize=4.9 K 2023-03-30 16:53:55,492 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8da1b06ca1f9816201b026631e89817 in 453ms, sequenceid=41, compaction requested=true 2023-03-30 16:53:55,492 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:55,492 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:53:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:53:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:53:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:53:55,496 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,496 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:55,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:55,496 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,496 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:53:55,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:55,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:53:55,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45d98ec8[Count = 0] remaining members to acquire global barrier 2023-03-30 16:53:55,498 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:53:55,498 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,499 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:53:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:53:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:53:55,500 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,500 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:53:55,501 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,501 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:53:55,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:53:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:55,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:53:55,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:53:55,511 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:53:55,511 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:53:55,511 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:53:55,511 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,511 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:53:55,513 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,513 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:53:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:53:55,513 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,515 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:53:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:53:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,517 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:53:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:55,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:55,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-30 16:53:55,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:53:55,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,520 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:53:55,521 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:53:55,523 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:53:55,520 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:53:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:53:55,623 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:53:55,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:53:55,625 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-30 16:53:55,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:53:55,628 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:53:55,630 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195835630 2023-03-30 16:53:55,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:53:55,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:53:55,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-30 16:53:55,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:55,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x2e8eb707 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:53:55,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48761892, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:53:55,668 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:56,148 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103395e055492e14b2d9efdf65291bdcbfb to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103395e055492e14b2d9efdf65291bdcbfb 2023-03-30 16:53:56,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:56,170 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:53:56,171 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49344, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:53:56,181 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:53:56,182 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43982, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:53:56,197 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c545b108acb5471eb3fbb8891d6eca18 first=Optional[r5] last=Optional[r6] 2023-03-30 16:53:56,198 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c545b108acb5471eb3fbb8891d6eca18}] 2023-03-30 16:53:56,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c545b108acb5471eb3fbb8891d6eca18 for inclusion in f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:56,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-30 16:53:56,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:53:56,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:56,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c545b108acb5471eb3fbb8891d6eca18 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jn1722nmh41pbtl7s3900o6ib3g4ssiim9bi1adtkr3ps9o23fj64amg4mn6jp6l/family1/c545b108acb5471eb3fbb8891d6eca18 2023-03-30 16:53:56,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jn1722nmh41pbtl7s3900o6ib3g4ssiim9bi1adtkr3ps9o23fj64amg4mn6jp6l/family1/c545b108acb5471eb3fbb8891d6eca18 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_ 2023-03-30 16:53:56,213 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jn1722nmh41pbtl7s3900o6ib3g4ssiim9bi1adtkr3ps9o23fj64amg4mn6jp6l/family1/c545b108acb5471eb3fbb8891d6eca18 into f8da1b06ca1f9816201b026631e89817/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_ - updating store file list. 2023-03-30 16:53:56,219 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_ into f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:56,219 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jn1722nmh41pbtl7s3900o6ib3g4ssiim9bi1adtkr3ps9o23fj64amg4mn6jp6l/family1/c545b108acb5471eb3fbb8891d6eca18 into f8da1b06ca1f9816201b026631e89817/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_) 2023-03-30 16:53:56,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jn1722nmh41pbtl7s3900o6ib3g4ssiim9bi1adtkr3ps9o23fj64amg4mn6jp6l/family1/c545b108acb5471eb3fbb8891d6eca18 2023-03-30 16:53:56,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-30 16:53:56,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-30 16:53:56,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(1912): f8da1b06ca1f9816201b026631e89817/family1 is initiating minor compaction 2023-03-30 16:53:56,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@636063a6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:56,227 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f8da1b06ca1f9816201b026631e89817/family1 in testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:56,228 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b96152d6d18c4b2fb52ce326f6454800, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/9e7eb3b593164f9d86dcbbe1ed648375, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/14fbd4936bce4c409dce5f558bb31e4a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/e77f37c92b514ac98f4345d81198fb22, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/239bddd52d4a4f06b0c4611301418aa1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/4928a1005de54589b2b11a9682b065de, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/99041c16dab84b898c16821317a804ac, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/766b1f0ab13844a39d8db5ec06af71c0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp, totalSize=49.7 K 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting b4d1a3e8a88e4f0c9a191eb22ab626ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting b96152d6d18c4b2fb52ce326f6454800, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 9e7eb3b593164f9d86dcbbe1ed648375, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 14fbd4936bce4c409dce5f558bb31e4a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting e77f37c92b514ac98f4345d81198fb22, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 239bddd52d4a4f06b0c4611301418aa1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 4928a1005de54589b2b11a9682b065de, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-30 16:53:56,228 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 99041c16dab84b898c16821317a804ac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-30 16:53:56,229 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 766b1f0ab13844a39d8db5ec06af71c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-30 16:53:56,229 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 5f46edb19a6c49a398c8140b93566762_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-30 16:53:56,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:56,233 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:56,235 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014dcb1faab6b24a958b9b43ec6dcc717d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014dcb1faab6b24a958b9b43ec6dcc717d 2023-03-30 16:53:56,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030d7c15a7f55848e886a25da23cb12944 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030d7c15a7f55848e886a25da23cb12944 2023-03-30 16:53:56,240 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-30 16:53:56,240 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-30 16:53:56,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:56,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:56,322 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): f8da1b06ca1f9816201b026631e89817#family1#compaction#22 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:53:56,732 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312ac4948a56e84343ac1c7365d8022749 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512312ac4948a56e84343ac1c7365d8022749 2023-03-30 16:53:56,733 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:56,761 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/2376e32348cb4bc3989978d98f942d51 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2376e32348cb4bc3989978d98f942d51 2023-03-30 16:53:56,770 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f8da1b06ca1f9816201b026631e89817/family1 of f8da1b06ca1f9816201b026631e89817 into 2376e32348cb4bc3989978d98f942d51(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:53:56,770 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:56,771 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1680195236227; duration=0sec 2023-03-30 16:53:56,771 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:56,784 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b4a6a38632d04b1b90539a51e87a7d14 first=Optional[r1] last=Optional[r4] 2023-03-30 16:53:56,784 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b4a6a38632d04b1b90539a51e87a7d14}] 2023-03-30 16:53:56,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b4a6a38632d04b1b90539a51e87a7d14 for inclusion in f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-30 16:53:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:53:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:56,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b4a6a38632d04b1b90539a51e87a7d14 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tin33p9av51rnqv5n9v5gt6fpqgga3gcfrj6hd2i1ocg76q099hjlj32jsee3h5a/family1/b4a6a38632d04b1b90539a51e87a7d14 2023-03-30 16:53:56,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tin33p9av51rnqv5n9v5gt6fpqgga3gcfrj6hd2i1ocg76q099hjlj32jsee3h5a/family1/b4a6a38632d04b1b90539a51e87a7d14 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_ 2023-03-30 16:53:56,798 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tin33p9av51rnqv5n9v5gt6fpqgga3gcfrj6hd2i1ocg76q099hjlj32jsee3h5a/family1/b4a6a38632d04b1b90539a51e87a7d14 into f8da1b06ca1f9816201b026631e89817/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_ - updating store file list. 2023-03-30 16:53:56,807 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_ into f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:56,807 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tin33p9av51rnqv5n9v5gt6fpqgga3gcfrj6hd2i1ocg76q099hjlj32jsee3h5a/family1/b4a6a38632d04b1b90539a51e87a7d14 into f8da1b06ca1f9816201b026631e89817/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_) 2023-03-30 16:53:56,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tin33p9av51rnqv5n9v5gt6fpqgga3gcfrj6hd2i1ocg76q099hjlj32jsee3h5a/family1/b4a6a38632d04b1b90539a51e87a7d14 2023-03-30 16:53:56,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-30 16:53:56,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-30 16:53:56,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(1912): f8da1b06ca1f9816201b026631e89817/family1 is initiating minor compaction (all files) 2023-03-30 16:53:56,810 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f8da1b06ca1f9816201b026631e89817/family1 in testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:53:56,810 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/d93d036e10614f8fa7c3504b9fc93813, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2376e32348cb4bc3989978d98f942d51, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp, totalSize=178.1 K 2023-03-30 16:53:56,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@120c5309; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:56,811 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting d93d036e10614f8fa7c3504b9fc93813, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839396 2023-03-30 16:53:56,811 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 2376e32348cb4bc3989978d98f942d51, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239396 2023-03-30 16:53:56,812 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 98b70fbf4269482f94ac6c653c65f79b_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965239396 2023-03-30 16:53:56,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:56,816 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:56,819 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014d5b33052ef8411db81241870f47cf34 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014d5b33052ef8411db81241870f47cf34 2023-03-30 16:53:56,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffdaea925f8146ccba797ef3cc971302 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffdaea925f8146ccba797ef3cc971302 2023-03-30 16:53:56,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f54c769ff047455eb80ff78963f13a87 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f54c769ff047455eb80ff78963f13a87 2023-03-30 16:53:56,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231210248e8203d438ca5f7b3897527db7c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231210248e8203d438ca5f7b3897527db7c 2023-03-30 16:53:56,831 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-30 16:53:56,831 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-30 16:53:56,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:56,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:56,847 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): f8da1b06ca1f9816201b026631e89817#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:53:56,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b96152d6d18c4b2fb52ce326f6454800, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/9e7eb3b593164f9d86dcbbe1ed648375, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/14fbd4936bce4c409dce5f558bb31e4a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/e77f37c92b514ac98f4345d81198fb22, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/239bddd52d4a4f06b0c4611301418aa1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/4928a1005de54589b2b11a9682b065de, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/99041c16dab84b898c16821317a804ac, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/766b1f0ab13844a39d8db5ec06af71c0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_] to archive 2023-03-30 16:53:56,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:56,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b4d1a3e8a88e4f0c9a191eb22ab626ec 2023-03-30 16:53:56,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b96152d6d18c4b2fb52ce326f6454800 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/b96152d6d18c4b2fb52ce326f6454800 2023-03-30 16:53:56,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/9e7eb3b593164f9d86dcbbe1ed648375 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/9e7eb3b593164f9d86dcbbe1ed648375 2023-03-30 16:53:56,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/14fbd4936bce4c409dce5f558bb31e4a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/14fbd4936bce4c409dce5f558bb31e4a 2023-03-30 16:53:56,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/e77f37c92b514ac98f4345d81198fb22 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/e77f37c92b514ac98f4345d81198fb22 2023-03-30 16:53:56,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/239bddd52d4a4f06b0c4611301418aa1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/239bddd52d4a4f06b0c4611301418aa1 2023-03-30 16:53:56,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/4928a1005de54589b2b11a9682b065de to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/4928a1005de54589b2b11a9682b065de 2023-03-30 16:53:56,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/99041c16dab84b898c16821317a804ac to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/99041c16dab84b898c16821317a804ac 2023-03-30 16:53:56,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/766b1f0ab13844a39d8db5ec06af71c0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/766b1f0ab13844a39d8db5ec06af71c0 2023-03-30 16:53:56,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/5f46edb19a6c49a398c8140b93566762_SeqId_44_ 2023-03-30 16:53:57,797 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/.tmp/family1/51378de14d0947a0a25afb4735a1d7ae as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/51378de14d0947a0a25afb4735a1d7ae 2023-03-30 16:53:57,806 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ca8d239d283e438ea17eda097a556fa6 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ca8d239d283e438ea17eda097a556fa6 2023-03-30 16:53:57,807 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f8da1b06ca1f9816201b026631e89817/family1 of f8da1b06ca1f9816201b026631e89817 into 51378de14d0947a0a25afb4735a1d7ae(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:53:57,807 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:57,807 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1680195236810; duration=0sec 2023-03-30 16:53:57,807 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:53:57,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:57,853 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe first=Optional[r00] last=Optional[r8] 2023-03-30 16:53:57,854 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe}] 2023-03-30 16:53:57,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/d93d036e10614f8fa7c3504b9fc93813, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2376e32348cb4bc3989978d98f942d51, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_] to archive 2023-03-30 16:53:57,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:57,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe for inclusion in f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:57,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/d93d036e10614f8fa7c3504b9fc93813 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/d93d036e10614f8fa7c3504b9fc93813 2023-03-30 16:53:57,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2376e32348cb4bc3989978d98f942d51 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2376e32348cb4bc3989978d98f942d51 2023-03-30 16:53:57,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-30 16:53:57,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:53:57,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:53:57,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/98b70fbf4269482f94ac6c653c65f79b_SeqId_47_ 2023-03-30 16:53:57,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__orh4rp4hkobl56ttuv9pjdqptiic1ai8d1h6gbgd4oo2m72b61hmqrvusvpa3ahg/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe 2023-03-30 16:53:57,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__orh4rp4hkobl56ttuv9pjdqptiic1ai8d1h6gbgd4oo2m72b61hmqrvusvpa3ahg/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2d522a0a4e34486a845f94cb0d78f7e7_SeqId_50_ 2023-03-30 16:53:57,874 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__orh4rp4hkobl56ttuv9pjdqptiic1ai8d1h6gbgd4oo2m72b61hmqrvusvpa3ahg/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe into f8da1b06ca1f9816201b026631e89817/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2d522a0a4e34486a845f94cb0d78f7e7_SeqId_50_ - updating store file list. 2023-03-30 16:53:57,884 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2d522a0a4e34486a845f94cb0d78f7e7_SeqId_50_ into f8da1b06ca1f9816201b026631e89817/family1 2023-03-30 16:53:57,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__orh4rp4hkobl56ttuv9pjdqptiic1ai8d1h6gbgd4oo2m72b61hmqrvusvpa3ahg/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe into f8da1b06ca1f9816201b026631e89817/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/family1/2d522a0a4e34486a845f94cb0d78f7e7_SeqId_50_) 2023-03-30 16:53:57,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithMonthlyPolicy__orh4rp4hkobl56ttuv9pjdqptiic1ai8d1h6gbgd4oo2m72b61hmqrvusvpa3ahg/family1/7978a0fc0ebe4aeb8ffdb4b176036ebe 2023-03-30 16:53:57,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:57,889 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:53:57,892 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bdd5e2a3ac9a451d9e64aed538f2478b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bdd5e2a3ac9a451d9e64aed538f2478b 2023-03-30 16:53:57,894 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5d1f3e1b635456c8571c6e250e7f800 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5d1f3e1b635456c8571c6e250e7f800 2023-03-30 16:53:57,896 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a135d0d395e44ca893b56fb5192377d0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a135d0d395e44ca893b56fb5192377d0 2023-03-30 16:53:57,896 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-30 16:53:57,896 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-30 16:53:57,897 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:57,897 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:57,897 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:53:57,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:53:57,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:53:57,899 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:53:57,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2730 sec 2023-03-30 16:53:58,015 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=258 (was 251) Potentially hanging thread: hconnection-0xc1473a1-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xc1473a1-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1748105607_15 at /127.0.0.1:56356 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56394 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xc1473a1-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56282 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56402 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56416 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xc1473a1-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56420 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56424 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56310 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x2e8eb707 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1719445576.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56290 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x2e8eb707-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56384 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64100@0x2e8eb707-SendThread(127.0.0.1:64100) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0xc1473a1-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56368 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1748105607_15 at /127.0.0.1:56344 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56302 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56220 [Waiting for operation #37] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4124be4e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xc1473a1-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56438 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xc1473a1-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56196 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_642574273_15 at /127.0.0.1:56350 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=625 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=413 (was 422), ProcessCount=169 (was 169), AvailableMemoryMB=4906 (was 5027) 2023-03-30 16:53:58,036 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=413, ProcessCount=169, AvailableMemoryMB=4905 2023-03-30 16:53:58,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-30 16:53:58,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:58,042 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:53:58,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-30 16:53:58,043 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:53:58,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-30 16:53:58,045 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,046 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d empty. 2023-03-30 16:53:58,047 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,047 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-30 16:53:58,076 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-30 16:53:58,096 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1f8a0a60d7251e694608e48a5753817d, NAME => 'testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:53:58,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-30 16:53:58,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-30 16:53:58,507 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:58,507 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 1f8a0a60d7251e694608e48a5753817d, disabling compactions & flushes 2023-03-30 16:53:58,507 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:58,507 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:58,507 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. after waiting 0 ms 2023-03-30 16:53:58,507 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:58,507 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:58,507 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:53:58,510 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:53:58,511 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680195238511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195238511"}]},"ts":"1680195238511"} 2023-03-30 16:53:58,513 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:53:58,514 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:53:58,515 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195238515"}]},"ts":"1680195238515"} 2023-03-30 16:53:58,516 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-30 16:53:58,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1f8a0a60d7251e694608e48a5753817d, ASSIGN}] 2023-03-30 16:53:58,524 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1f8a0a60d7251e694608e48a5753817d, ASSIGN 2023-03-30 16:53:58,525 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1f8a0a60d7251e694608e48a5753817d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:53:58,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-30 16:53:58,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1f8a0a60d7251e694608e48a5753817d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:58,676 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680195238676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195238676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195238676"}]},"ts":"1680195238676"} 2023-03-30 16:53:58,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 1f8a0a60d7251e694608e48a5753817d, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:53:58,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:58,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f8a0a60d7251e694608e48a5753817d, NAME => 'testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:53:58,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:53:58,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,836 INFO [StoreOpener-1f8a0a60d7251e694608e48a5753817d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,838 DEBUG [StoreOpener-1f8a0a60d7251e694608e48a5753817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1 2023-03-30 16:53:58,838 DEBUG [StoreOpener-1f8a0a60d7251e694608e48a5753817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1 2023-03-30 16:53:58,838 INFO [StoreOpener-1f8a0a60d7251e694608e48a5753817d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f8a0a60d7251e694608e48a5753817d columnFamilyName family1 2023-03-30 16:53:58,840 INFO [StoreOpener-1f8a0a60d7251e694608e48a5753817d-1] regionserver.HStore(310): Store=1f8a0a60d7251e694608e48a5753817d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:53:58,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:53:58,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:53:58,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1f8a0a60d7251e694608e48a5753817d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67572557, jitterRate=0.006909564137458801}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:53:58,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:53:58,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d., pid=25, masterSystemTime=1680195238830 2023-03-30 16:53:58,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:58,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:58,851 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1f8a0a60d7251e694608e48a5753817d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:58,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680195238851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195238851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195238851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195238851"}]},"ts":"1680195238851"} 2023-03-30 16:53:58,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-30 16:53:58,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 1f8a0a60d7251e694608e48a5753817d, server=jenkins-hbase4.apache.org,39029,1680195214375 in 175 msec 2023-03-30 16:53:58,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-30 16:53:58,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1f8a0a60d7251e694608e48a5753817d, ASSIGN in 334 msec 2023-03-30 16:53:58,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:53:58,862 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195238862"}]},"ts":"1680195238862"} 2023-03-30 16:53:58,863 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-30 16:53:58,867 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:53:58,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 828 msec 2023-03-30 16:53:59,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-30 16:53:59,150 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-30 16:53:59,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:53:59,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,188 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:53:59,188 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:59,188 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:53:59,188 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:53:59,189 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,189 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,190 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:53:59,190 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:59,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:53:59,190 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:53:59,190 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:53:59,191 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:53:59,192 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:53:59,192 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:53:59,197 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:53:59,197 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:53:59,197 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:53:59,197 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:53:59,198 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-30 16:53:59,630 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309f0758066db649d5a240fca6f8e4a610 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511309f0758066db649d5a240fca6f8e4a610 2023-03-30 16:54:00,034 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/3e61ff8828454ee09ecc32be31db6ff6 2023-03-30 16:54:00,041 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/3e61ff8828454ee09ecc32be31db6ff6 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/3e61ff8828454ee09ecc32be31db6ff6 2023-03-30 16:54:00,046 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/3e61ff8828454ee09ecc32be31db6ff6, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-30 16:54:00,047 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 849ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:00,047 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:00,048 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:00,048 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:00,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:00,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:00,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:00,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:00,050 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,050 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:00,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:00,050 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,050 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:00,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:00,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:00,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:00,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:00,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a66c32[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:00,052 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:00,052 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,054 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:00,054 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,055 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:00,056 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:00,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:00,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:00,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:00,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:00,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:00,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:00,058 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:00,058 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:00,058 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:00,058 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,058 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:00,060 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,060 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:00,060 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,060 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:00,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:00,061 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:00,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,063 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,063 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,063 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,063 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:00,063 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:00,064 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:00,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:00,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:00,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:00,064 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:00,064 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:00,064 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,064 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:00,064 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,064 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:00,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:00,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:00,164 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:00,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:00,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:00,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:00,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,171 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:00,171 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:00,171 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:00,171 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:00,172 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,172 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,176 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:00,176 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:00,177 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:00,177 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,178 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:00,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:00,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:00,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:00,178 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-30 16:54:00,592 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282ad8d19ebddb45a9a7766f9743c6236a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511282ad8d19ebddb45a9a7766f9743c6236a 2023-03-30 16:54:00,998 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/64573de12cbb4a019ffab6930a5f5524 2023-03-30 16:54:01,003 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/64573de12cbb4a019ffab6930a5f5524 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/64573de12cbb4a019ffab6930a5f5524 2023-03-30 16:54:01,008 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/64573de12cbb4a019ffab6930a5f5524, entries=1, sequenceid=9, filesize=5.0 K 2023-03-30 16:54:01,009 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 831ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:01,009 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:01,009 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:01,009 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:01,009 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:01,009 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,009 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:01,009 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:01,011 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,011 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:01,011 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,011 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:01,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b2f7769[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:01,013 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:01,013 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,014 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,014 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:01,014 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:01,014 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,014 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:01,014 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:01,016 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:01,016 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,016 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:01,016 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:01,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:01,018 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:01,018 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:01,018 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:01,018 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,018 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:01,020 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,020 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:01,020 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:01,021 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,022 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,024 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,024 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:01,024 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:01,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:01,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:01,024 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,024 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:01,024 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:01,024 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:01,024 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,025 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:01,025 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,025 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:01,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:01,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:01,025 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,125 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:01,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:01,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:01,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,132 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:01,132 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:01,132 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:01,133 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:01,133 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,133 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,134 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,134 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:01,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:01,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:01,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,135 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,136 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:01,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,136 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:01,136 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:01,136 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:01,136 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:01,136 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:01,136 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:01,136 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:01,136 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:01,550 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201da0724cf685b4836b5746ef3077398a2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201da0724cf685b4836b5746ef3077398a2 2023-03-30 16:54:01,957 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/cd9bfdcde937432aa88ef0a7b38ddcd6 2023-03-30 16:54:01,962 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/cd9bfdcde937432aa88ef0a7b38ddcd6 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/cd9bfdcde937432aa88ef0a7b38ddcd6 2023-03-30 16:54:01,967 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/cd9bfdcde937432aa88ef0a7b38ddcd6, entries=1, sequenceid=13, filesize=4.9 K 2023-03-30 16:54:01,968 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 832ms, sequenceid=13, compaction requested=true 2023-03-30 16:54:01,969 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:01,969 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:01,969 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:01,969 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:01,969 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,969 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:01,969 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:01,971 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3146bcca[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:01,973 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:01,973 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,975 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,975 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:01,975 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:01,975 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:01,975 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,975 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:01,977 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:01,977 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,977 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,977 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:01,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:01,979 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:01,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:01,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:01,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,979 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:01,980 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,980 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:01,980 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,981 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,982 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:01,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:01,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:01,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:01,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:01,988 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:01,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:01,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:01,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:01,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,989 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:01,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:01,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:01,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:01,989 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:01,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,089 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:02,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:02,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:02,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:02,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,096 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:02,096 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:02,096 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:02,096 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:02,097 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,097 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,098 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:02,098 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:02,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:02,099 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,099 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:02,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,100 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:02,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:02,101 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:02,101 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:02,101 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:02,101 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:02,515 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057a8755f9082646499bf83885a007bb9e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057a8755f9082646499bf83885a007bb9e 2023-03-30 16:54:02,921 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/04720c56a1f4414d875a683992ffd250 2023-03-30 16:54:02,927 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/04720c56a1f4414d875a683992ffd250 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/04720c56a1f4414d875a683992ffd250 2023-03-30 16:54:02,932 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/04720c56a1f4414d875a683992ffd250, entries=1, sequenceid=17, filesize=4.9 K 2023-03-30 16:54:02,933 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 832ms, sequenceid=17, compaction requested=true 2023-03-30 16:54:02,933 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:02,933 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:02,935 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,935 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38e0dbe4[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:02,937 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:02,937 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,939 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,939 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:02,939 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:02,939 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:02,939 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,939 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:02,941 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,941 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:02,941 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:02,941 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:02,943 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:02,943 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:02,943 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:02,943 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,943 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:02,945 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,945 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:02,945 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:02,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:02,946 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,947 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:02,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:02,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:02,949 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:02,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:02,949 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:02,950 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:02,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:03,050 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:03,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:03,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:03,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:03,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,057 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:03,057 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:03,057 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:03,057 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:03,058 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,058 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,059 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:03,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:03,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:03,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,060 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,060 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:03,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,060 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:03,060 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:03,060 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:03,061 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:03,061 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:03,061 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:03,061 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:03,061 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:03,475 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282d2f4fceca2841608981ec43ae759b1f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512282d2f4fceca2841608981ec43ae759b1f 2023-03-30 16:54:03,882 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/13c4653441bf459aadae2196d124622d 2023-03-30 16:54:03,888 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/13c4653441bf459aadae2196d124622d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/13c4653441bf459aadae2196d124622d 2023-03-30 16:54:03,893 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/13c4653441bf459aadae2196d124622d, entries=1, sequenceid=21, filesize=4.9 K 2023-03-30 16:54:03,894 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 833ms, sequenceid=21, compaction requested=true 2023-03-30 16:54:03,894 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:03,894 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:03,894 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:03,894 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:03,894 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,894 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:03,894 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:03,896 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7867e736[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:03,897 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:03,898 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,899 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,899 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:03,899 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:03,899 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:03,899 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,899 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:03,900 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:03,900 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:03,900 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,900 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:03,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:03,903 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:03,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:03,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:03,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,903 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:03,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:03,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:03,906 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:03,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,907 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:03,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,910 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:03,910 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:03,910 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:03,910 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:03,910 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:03,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:03,910 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:03,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:03,911 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:03,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:03,911 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:03,911 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,911 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:03,911 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:03,911 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,011 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:04,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:04,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:04,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:04,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,018 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:04,018 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:04,018 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:04,018 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:04,019 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,019 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,020 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:04,020 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:04,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:04,020 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,020 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:04,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:04,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,021 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:04,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:04,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:04,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:04,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:04,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:04,022 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:04,022 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:04,022 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:04,336 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:54:04,369 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:04,369 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e8eb707 to 127.0.0.1:64100 2023-03-30 16:54:04,369 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:04,370 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:04,370 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6492ee74 to 127.0.0.1:64100 2023-03-30 16:54:04,370 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:04,371 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:04,371 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x483ac863 to 127.0.0.1:64100 2023-03-30 16:54:04,371 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:04,435 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231453eeb83bb4f450e8202fe63a6c61f51 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231453eeb83bb4f450e8202fe63a6c61f51 2023-03-30 16:54:04,841 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/41947a2676cb47e3b611a0c81b4519cb 2023-03-30 16:54:04,846 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/41947a2676cb47e3b611a0c81b4519cb as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/41947a2676cb47e3b611a0c81b4519cb 2023-03-30 16:54:04,850 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/41947a2676cb47e3b611a0c81b4519cb, entries=1, sequenceid=25, filesize=4.9 K 2023-03-30 16:54:04,851 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 829ms, sequenceid=25, compaction requested=true 2023-03-30 16:54:04,851 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:04,851 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:04,851 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:04,851 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:04,851 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,851 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:04,851 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:04,853 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,853 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:04,853 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,853 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:04,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:04,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4843436c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:04,855 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:04,855 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,856 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,857 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:04,857 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:04,857 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:04,857 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,857 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:04,861 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:04,861 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:04,861 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,862 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:04,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:04,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:04,864 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:04,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:04,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:04,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,864 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:04,866 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,866 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:04,866 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,866 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:04,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,867 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,870 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:04,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:04,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:04,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:04,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:04,870 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,871 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:04,871 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,871 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,971 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:04,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:04,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:04,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:04,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,979 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:04,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:04,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:04,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:04,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,982 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,982 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:04,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:04,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:04,983 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:04,983 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:04,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:04,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,983 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:04,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:04,984 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:04,984 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:04,984 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:05,400 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013da138bccd6b4523a92ef48233e42bdf to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013da138bccd6b4523a92ef48233e42bdf 2023-03-30 16:54:05,805 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/68027fe2c0454cb5849f3a5e95d0446f 2023-03-30 16:54:05,811 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/68027fe2c0454cb5849f3a5e95d0446f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/68027fe2c0454cb5849f3a5e95d0446f 2023-03-30 16:54:05,815 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/68027fe2c0454cb5849f3a5e95d0446f, entries=1, sequenceid=29, filesize=4.9 K 2023-03-30 16:54:05,816 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 832ms, sequenceid=29, compaction requested=true 2023-03-30 16:54:05,816 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:05,816 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:05,816 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:05,816 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:05,816 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,816 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:05,816 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:05,818 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,818 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:05,818 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,818 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:05,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:05,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ce71642[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:05,820 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:05,820 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,821 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,821 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:05,821 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,821 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:05,821 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:05,821 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:05,824 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:05,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:05,824 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:05,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:05,826 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:05,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:05,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:05,826 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,826 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:05,827 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,827 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:05,828 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,828 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:05,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,829 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,831 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:05,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:05,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:05,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:05,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:05,831 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:05,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:05,832 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,832 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:05,832 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:05,832 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:05,932 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:05,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:05,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:05,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:05,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,940 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:05,940 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:05,940 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:05,940 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:05,941 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,941 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,942 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,942 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:05,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:05,942 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:05,942 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,943 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:05,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:05,943 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:05,943 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:05,943 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:05,943 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:05,944 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:05,944 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:05,944 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:05,944 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:06,357 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c3a5cdfb064644b0bdf0a0aaa928351f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c3a5cdfb064644b0bdf0a0aaa928351f 2023-03-30 16:54:06,763 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/896fef4586ed45c7ba4157ffc91e5300 2023-03-30 16:54:06,768 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/896fef4586ed45c7ba4157ffc91e5300 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/896fef4586ed45c7ba4157ffc91e5300 2023-03-30 16:54:06,773 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/896fef4586ed45c7ba4157ffc91e5300, entries=1, sequenceid=33, filesize=4.9 K 2023-03-30 16:54:06,774 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 830ms, sequenceid=33, compaction requested=true 2023-03-30 16:54:06,774 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:06,774 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:06,774 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:06,774 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:06,774 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,774 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:06,774 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:06,777 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,777 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:06,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:06,777 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:06,777 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:06,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:06,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72e6cbc1[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:06,779 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:06,779 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,780 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,780 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:06,780 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:06,780 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,780 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:06,780 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:06,782 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:06,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:06,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:06,782 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:06,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:06,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:06,784 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:06,785 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:06,785 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:06,785 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,785 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:06,786 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,786 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,786 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:06,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:06,791 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,792 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:06,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:06,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:06,795 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:06,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:06,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:06,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:06,795 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,796 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:06,796 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:06,896 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:06,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:06,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:06,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:06,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,903 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:06,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:06,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:06,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:06,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,903 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:06,905 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:06,905 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:06,905 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:06,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,906 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:06,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:06,906 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:06,906 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:06,906 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:06,906 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:06,906 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:06,906 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:06,906 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:06,906 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:07,320 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907878466e609e8460b8ff67eaeb27c467a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907878466e609e8460b8ff67eaeb27c467a 2023-03-30 16:54:07,726 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/5bfa0fd558f44169a538ff906e19c17c 2023-03-30 16:54:07,731 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/5bfa0fd558f44169a538ff906e19c17c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/5bfa0fd558f44169a538ff906e19c17c 2023-03-30 16:54:07,735 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/5bfa0fd558f44169a538ff906e19c17c, entries=1, sequenceid=37, filesize=4.9 K 2023-03-30 16:54:07,736 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 830ms, sequenceid=37, compaction requested=true 2023-03-30 16:54:07,736 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:07,736 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:07,736 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:07,737 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:07,737 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,737 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:07,737 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:07,739 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,739 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:07,739 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,739 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35ffdcfc[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:07,740 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:07,741 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,744 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,744 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:07,744 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:07,744 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,744 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:07,744 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:07,747 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:07,747 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,747 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:07,747 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:07,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:07,749 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:07,749 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:07,749 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:07,749 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,749 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:07,751 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,751 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,751 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:07,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:07,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:07,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,751 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:07,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,752 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:07,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,755 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,755 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:07,755 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:07,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:07,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:07,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:07,755 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:07,755 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:07,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:07,755 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:07,755 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,756 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:07,756 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:07,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:07,756 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,756 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,756 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,856 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:07,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:07,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:07,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:07,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,862 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:07,862 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:07,862 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:07,863 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:07,863 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,863 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:07,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:07,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:07,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,865 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:07,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:07,865 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:07,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:07,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:07,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:07,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:07,866 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:07,866 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. started... 2023-03-30 16:54:07,866 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1f8a0a60d7251e694608e48a5753817d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:08,279 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112008bd06294b4944a7b1ba2dde28ed0963 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112008bd06294b4944a7b1ba2dde28ed0963 2023-03-30 16:54:08,685 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/37648d4b339f4ff389e3cab7371005ab 2023-03-30 16:54:08,690 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/37648d4b339f4ff389e3cab7371005ab as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/37648d4b339f4ff389e3cab7371005ab 2023-03-30 16:54:08,695 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/37648d4b339f4ff389e3cab7371005ab, entries=1, sequenceid=41, filesize=4.9 K 2023-03-30 16:54:08,696 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1f8a0a60d7251e694608e48a5753817d in 829ms, sequenceid=41, compaction requested=true 2023-03-30 16:54:08,696 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:08,696 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:08,697 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,697 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:08,698 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:08,698 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:08,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:08,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6775b10c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:08,699 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:08,699 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,700 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,701 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:08,701 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:08,701 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:08,701 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,701 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:08,702 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:08,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:08,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:08,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:08,704 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:08,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:08,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:08,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,705 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:08,707 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,707 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:08,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:08,707 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:08,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:08,708 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,709 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,711 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,711 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,711 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:08,711 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:08,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-30 16:54:08,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:08,711 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:08,711 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:08,711 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:08,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:08,712 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:08,712 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,712 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:08,712 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:08,712 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:08,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:08,812 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:08,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:08,814 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-30 16:54:08,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:54:08,817 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:54:08,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:08,818 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195848818 2023-03-30 16:54:08,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-30 16:54:08,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-30 16:54:08,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:08,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x755abd44 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:08,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d1099f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:08,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,276 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f57a22f10e214c73a0103242d1f4a019 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103f57a22f10e214c73a0103242d1f4a019 2023-03-30 16:54:09,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:09,297 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:09,298 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36578, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:09,311 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:09,318 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49996, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:09,344 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3816f61ed4824513bd6f99b28b0f7fad first=Optional[r3] last=Optional[r6] 2023-03-30 16:54:09,348 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3816f61ed4824513bd6f99b28b0f7fad}] 2023-03-30 16:54:09,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3816f61ed4824513bd6f99b28b0f7fad for inclusion in 1f8a0a60d7251e694608e48a5753817d/family1 2023-03-30 16:54:09,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-30 16:54:09,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:09,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:09,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3816f61ed4824513bd6f99b28b0f7fad to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k53rum9kc22p7hht9pkqdgaer9ovsd9ckmggkt0all0u1rr0h38cput77mbg7pld/family1/3816f61ed4824513bd6f99b28b0f7fad 2023-03-30 16:54:09,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k53rum9kc22p7hht9pkqdgaer9ovsd9ckmggkt0all0u1rr0h38cput77mbg7pld/family1/3816f61ed4824513bd6f99b28b0f7fad as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_ 2023-03-30 16:54:09,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k53rum9kc22p7hht9pkqdgaer9ovsd9ckmggkt0all0u1rr0h38cput77mbg7pld/family1/3816f61ed4824513bd6f99b28b0f7fad into 1f8a0a60d7251e694608e48a5753817d/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_ - updating store file list. 2023-03-30 16:54:09,374 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_ into 1f8a0a60d7251e694608e48a5753817d/family1 2023-03-30 16:54:09,388 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k53rum9kc22p7hht9pkqdgaer9ovsd9ckmggkt0all0u1rr0h38cput77mbg7pld/family1/3816f61ed4824513bd6f99b28b0f7fad into 1f8a0a60d7251e694608e48a5753817d/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_) 2023-03-30 16:54:09,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k53rum9kc22p7hht9pkqdgaer9ovsd9ckmggkt0all0u1rr0h38cput77mbg7pld/family1/3816f61ed4824513bd6f99b28b0f7fad 2023-03-30 16:54:09,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-30 16:54:09,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-30 16:54:09,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(1912): 1f8a0a60d7251e694608e48a5753817d/family1 is initiating minor compaction 2023-03-30 16:54:09,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3046914f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:09,400 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1f8a0a60d7251e694608e48a5753817d/family1 in testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:09,401 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/64573de12cbb4a019ffab6930a5f5524, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/cd9bfdcde937432aa88ef0a7b38ddcd6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/04720c56a1f4414d875a683992ffd250, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/13c4653441bf459aadae2196d124622d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/41947a2676cb47e3b611a0c81b4519cb, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/68027fe2c0454cb5849f3a5e95d0446f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/896fef4586ed45c7ba4157ffc91e5300, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/5bfa0fd558f44169a538ff906e19c17c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/37648d4b339f4ff389e3cab7371005ab, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp, totalSize=50.0 K 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 64573de12cbb4a019ffab6930a5f5524, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting cd9bfdcde937432aa88ef0a7b38ddcd6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 04720c56a1f4414d875a683992ffd250, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 13c4653441bf459aadae2196d124622d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 41947a2676cb47e3b611a0c81b4519cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 68027fe2c0454cb5849f3a5e95d0446f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 896fef4586ed45c7ba4157ffc91e5300, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-30 16:54:09,401 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 5bfa0fd558f44169a538ff906e19c17c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-30 16:54:09,402 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 37648d4b339f4ff389e3cab7371005ab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-30 16:54:09,402 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 2de98df83ee0449297d1901f6cc0f95e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-30 16:54:09,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:09,404 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:09,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512282d2f4fceca2841608981ec43ae759b1f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512282d2f4fceca2841608981ec43ae759b1f 2023-03-30 16:54:09,408 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231453eeb83bb4f450e8202fe63a6c61f51 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231453eeb83bb4f450e8202fe63a6c61f51 2023-03-30 16:54:09,410 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013da138bccd6b4523a92ef48233e42bdf to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013da138bccd6b4523a92ef48233e42bdf 2023-03-30 16:54:09,412 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c3a5cdfb064644b0bdf0a0aaa928351f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c3a5cdfb064644b0bdf0a0aaa928351f 2023-03-30 16:54:09,413 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-30 16:54:09,413 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,500 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1f8a0a60d7251e694608e48a5753817d#family1#compaction#34 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:09,562 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205806392bd10294d65af8340377af2ca86 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205806392bd10294d65af8340377af2ca86 2023-03-30 16:54:09,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:09,587 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/a2de35f6304345108f599acadb98d2e3 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/a2de35f6304345108f599acadb98d2e3 2023-03-30 16:54:09,595 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1f8a0a60d7251e694608e48a5753817d/family1 of 1f8a0a60d7251e694608e48a5753817d into a2de35f6304345108f599acadb98d2e3(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:09,595 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:09,595 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1680195249400; duration=0sec 2023-03-30 16:54:09,595 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:09,619 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d7b89e12aeb4c6484502af7e3d568bb first=Optional[r1] last=Optional[r2] 2023-03-30 16:54:09,620 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d7b89e12aeb4c6484502af7e3d568bb}] 2023-03-30 16:54:09,624 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d7b89e12aeb4c6484502af7e3d568bb for inclusion in 1f8a0a60d7251e694608e48a5753817d/family1 2023-03-30 16:54:09,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-30 16:54:09,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:09,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:09,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d7b89e12aeb4c6484502af7e3d568bb to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vo2ns2qph2871o5l8793c6g8e02nj1m3d55m7ocf8no7cm4ekk0593rcfs4t0sv/family1/1d7b89e12aeb4c6484502af7e3d568bb 2023-03-30 16:54:09,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vo2ns2qph2871o5l8793c6g8e02nj1m3d55m7ocf8no7cm4ekk0593rcfs4t0sv/family1/1d7b89e12aeb4c6484502af7e3d568bb as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_ 2023-03-30 16:54:09,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vo2ns2qph2871o5l8793c6g8e02nj1m3d55m7ocf8no7cm4ekk0593rcfs4t0sv/family1/1d7b89e12aeb4c6484502af7e3d568bb into 1f8a0a60d7251e694608e48a5753817d/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_ - updating store file list. 2023-03-30 16:54:09,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_ into 1f8a0a60d7251e694608e48a5753817d/family1 2023-03-30 16:54:09,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vo2ns2qph2871o5l8793c6g8e02nj1m3d55m7ocf8no7cm4ekk0593rcfs4t0sv/family1/1d7b89e12aeb4c6484502af7e3d568bb into 1f8a0a60d7251e694608e48a5753817d/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_) 2023-03-30 16:54:09,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vo2ns2qph2871o5l8793c6g8e02nj1m3d55m7ocf8no7cm4ekk0593rcfs4t0sv/family1/1d7b89e12aeb4c6484502af7e3d568bb 2023-03-30 16:54:09,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-30 16:54:09,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-30 16:54:09,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(1912): 1f8a0a60d7251e694608e48a5753817d/family1 is initiating minor compaction (all files) 2023-03-30 16:54:09,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5a80d68c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:09,649 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1f8a0a60d7251e694608e48a5753817d/family1 in testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:54:09,649 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/3e61ff8828454ee09ecc32be31db6ff6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/a2de35f6304345108f599acadb98d2e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp, totalSize=176.8 K 2023-03-30 16:54:09,650 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 3e61ff8828454ee09ecc32be31db6ff6, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839396 2023-03-30 16:54:09,650 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting a2de35f6304345108f599acadb98d2e3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239396 2023-03-30 16:54:09,651 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 6b2d412fd49b4178bb047ae000333771_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965239396 2023-03-30 16:54:09,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:09,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:09,685 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201da0724cf685b4836b5746ef3077398a2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201da0724cf685b4836b5746ef3077398a2 2023-03-30 16:54:09,701 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057a8755f9082646499bf83885a007bb9e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057a8755f9082646499bf83885a007bb9e 2023-03-30 16:54:09,701 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-30 16:54:09,701 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-30 16:54:09,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/64573de12cbb4a019ffab6930a5f5524, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/cd9bfdcde937432aa88ef0a7b38ddcd6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/04720c56a1f4414d875a683992ffd250, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/13c4653441bf459aadae2196d124622d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/41947a2676cb47e3b611a0c81b4519cb, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/68027fe2c0454cb5849f3a5e95d0446f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/896fef4586ed45c7ba4157ffc91e5300, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/5bfa0fd558f44169a538ff906e19c17c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/37648d4b339f4ff389e3cab7371005ab, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_] to archive 2023-03-30 16:54:09,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:09,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/64573de12cbb4a019ffab6930a5f5524 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/64573de12cbb4a019ffab6930a5f5524 2023-03-30 16:54:09,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/cd9bfdcde937432aa88ef0a7b38ddcd6 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/cd9bfdcde937432aa88ef0a7b38ddcd6 2023-03-30 16:54:09,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/04720c56a1f4414d875a683992ffd250 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/04720c56a1f4414d875a683992ffd250 2023-03-30 16:54:09,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:09,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:09,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:09,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/13c4653441bf459aadae2196d124622d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/13c4653441bf459aadae2196d124622d 2023-03-30 16:54:09,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/41947a2676cb47e3b611a0c81b4519cb to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/41947a2676cb47e3b611a0c81b4519cb 2023-03-30 16:54:09,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/68027fe2c0454cb5849f3a5e95d0446f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/68027fe2c0454cb5849f3a5e95d0446f 2023-03-30 16:54:09,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/896fef4586ed45c7ba4157ffc91e5300 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/896fef4586ed45c7ba4157ffc91e5300 2023-03-30 16:54:09,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/5bfa0fd558f44169a538ff906e19c17c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/5bfa0fd558f44169a538ff906e19c17c 2023-03-30 16:54:09,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/37648d4b339f4ff389e3cab7371005ab to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/37648d4b339f4ff389e3cab7371005ab 2023-03-30 16:54:09,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/2de98df83ee0449297d1901f6cc0f95e_SeqId_44_ 2023-03-30 16:54:09,741 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:54:09,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 926 msec 2023-03-30 16:54:09,748 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1f8a0a60d7251e694608e48a5753817d#family1#compaction#35 average throughput is 7.73 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:09,905 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=252 (was 258), OpenFileDescriptor=592 (was 625), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 413), ProcessCount=169 (was 169), AvailableMemoryMB=4815 (was 4905) 2023-03-30 16:54:09,928 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=169, AvailableMemoryMB=4813 2023-03-30 16:54:09,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-30 16:54:09,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:09,935 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:54:09,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-30 16:54:09,936 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:54:09,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-30 16:54:09,939 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:09,946 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:09,948 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff empty. 2023-03-30 16:54:09,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:09,948 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d empty. 2023-03-30 16:54:09,949 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c empty. 2023-03-30 16:54:09,949 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:09,950 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:09,950 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:09,950 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-30 16:54:09,968 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:09,970 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 311a5d950d0b7283733d4b334d0089ff, NAME => 'testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:09,972 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => dac04c396edf38306458db05404e6c7d, NAME => 'testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:09,973 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 800b35d7d26b9866a6511c5f834c181c, NAME => 'testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:10,017 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:10,017 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 311a5d950d0b7283733d4b334d0089ff, disabling compactions & flushes 2023-03-30 16:54:10,017 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:10,017 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:10,017 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. after waiting 0 ms 2023-03-30 16:54:10,017 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:10,017 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:10,017 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 311a5d950d0b7283733d4b334d0089ff: 2023-03-30 16:54:10,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-30 16:54:10,234 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/.tmp/family1/6c9d199679b2460ebbd80845ece65075 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6c9d199679b2460ebbd80845ece65075 2023-03-30 16:54:10,244 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1f8a0a60d7251e694608e48a5753817d/family1 of 1f8a0a60d7251e694608e48a5753817d into 6c9d199679b2460ebbd80845ece65075(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:10,244 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:54:10,245 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1680195249649; duration=0sec 2023-03-30 16:54:10,245 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:10,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-30 16:54:10,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/3e61ff8828454ee09ecc32be31db6ff6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/a2de35f6304345108f599acadb98d2e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_] to archive 2023-03-30 16:54:10,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:10,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/3e61ff8828454ee09ecc32be31db6ff6 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/3e61ff8828454ee09ecc32be31db6ff6 2023-03-30 16:54:10,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/a2de35f6304345108f599acadb98d2e3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/a2de35f6304345108f599acadb98d2e3 2023-03-30 16:54:10,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/family1/6b2d412fd49b4178bb047ae000333771_SeqId_47_ 2023-03-30 16:54:10,407 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:10,407 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 800b35d7d26b9866a6511c5f834c181c, disabling compactions & flushes 2023-03-30 16:54:10,407 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:10,407 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:10,407 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. after waiting 0 ms 2023-03-30 16:54:10,407 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:10,407 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:10,407 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 800b35d7d26b9866a6511c5f834c181c: 2023-03-30 16:54:10,420 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:10,420 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing dac04c396edf38306458db05404e6c7d, disabling compactions & flushes 2023-03-30 16:54:10,420 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:10,420 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:10,420 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. after waiting 0 ms 2023-03-30 16:54:10,420 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:10,420 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:10,420 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for dac04c396edf38306458db05404e6c7d: 2023-03-30 16:54:10,424 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:54:10,425 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680195250425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195250425"}]},"ts":"1680195250425"} 2023-03-30 16:54:10,425 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680195250425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195250425"}]},"ts":"1680195250425"} 2023-03-30 16:54:10,425 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680195250425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195250425"}]},"ts":"1680195250425"} 2023-03-30 16:54:10,437 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-30 16:54:10,438 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:54:10,438 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195250438"}]},"ts":"1680195250438"} 2023-03-30 16:54:10,441 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-30 16:54:10,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=311a5d950d0b7283733d4b334d0089ff, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dac04c396edf38306458db05404e6c7d, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=800b35d7d26b9866a6511c5f834c181c, ASSIGN}] 2023-03-30 16:54:10,447 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=800b35d7d26b9866a6511c5f834c181c, ASSIGN 2023-03-30 16:54:10,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dac04c396edf38306458db05404e6c7d, ASSIGN 2023-03-30 16:54:10,448 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=311a5d950d0b7283733d4b334d0089ff, ASSIGN 2023-03-30 16:54:10,448 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=800b35d7d26b9866a6511c5f834c181c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:10,450 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dac04c396edf38306458db05404e6c7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:10,451 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=311a5d950d0b7283733d4b334d0089ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:10,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-30 16:54:10,601 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=dac04c396edf38306458db05404e6c7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:10,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=311a5d950d0b7283733d4b334d0089ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:10,601 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680195250601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195250601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195250601"}]},"ts":"1680195250601"} 2023-03-30 16:54:10,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680195250601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195250601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195250601"}]},"ts":"1680195250601"} 2023-03-30 16:54:10,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=800b35d7d26b9866a6511c5f834c181c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:10,602 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680195250601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195250601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195250601"}]},"ts":"1680195250601"} 2023-03-30 16:54:10,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure dac04c396edf38306458db05404e6c7d, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:10,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 311a5d950d0b7283733d4b334d0089ff, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:10,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 800b35d7d26b9866a6511c5f834c181c, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:10,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:10,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 311a5d950d0b7283733d4b334d0089ff, NAME => 'testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff.', STARTKEY => '', ENDKEY => '1'} 2023-03-30 16:54:10,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:10,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,764 INFO [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,766 DEBUG [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff/family1 2023-03-30 16:54:10,766 DEBUG [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff/family1 2023-03-30 16:54:10,766 INFO [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 311a5d950d0b7283733d4b334d0089ff columnFamilyName family1 2023-03-30 16:54:10,768 INFO [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] regionserver.HStore(310): Store=311a5d950d0b7283733d4b334d0089ff/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:10,769 INFO [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,770 DEBUG [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff/family2 2023-03-30 16:54:10,770 DEBUG [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff/family2 2023-03-30 16:54:10,770 INFO [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 311a5d950d0b7283733d4b334d0089ff columnFamilyName family2 2023-03-30 16:54:10,772 INFO [StoreOpener-311a5d950d0b7283733d4b334d0089ff-1] regionserver.HStore(310): Store=311a5d950d0b7283733d4b334d0089ff/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:10,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:54:10,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:54:10,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:10,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 311a5d950d0b7283733d4b334d0089ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71166824, jitterRate=0.060468316078186035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:54:10,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 311a5d950d0b7283733d4b334d0089ff: 2023-03-30 16:54:10,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff., pid=32, masterSystemTime=1680195250758 2023-03-30 16:54:10,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:10,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:10,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:10,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 800b35d7d26b9866a6511c5f834c181c, NAME => 'testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c.', STARTKEY => '2', ENDKEY => ''} 2023-03-30 16:54:10,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=311a5d950d0b7283733d4b334d0089ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:10,787 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680195250787"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195250787"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195250787"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195250787"}]},"ts":"1680195250787"} 2023-03-30 16:54:10,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:10,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,789 INFO [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,790 DEBUG [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1 2023-03-30 16:54:10,791 DEBUG [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1 2023-03-30 16:54:10,791 INFO [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 800b35d7d26b9866a6511c5f834c181c columnFamilyName family1 2023-03-30 16:54:10,793 INFO [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] regionserver.HStore(310): Store=800b35d7d26b9866a6511c5f834c181c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:10,794 INFO [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-03-30 16:54:10,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 311a5d950d0b7283733d4b334d0089ff, server=jenkins-hbase4.apache.org,39029,1680195214375 in 188 msec 2023-03-30 16:54:10,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=311a5d950d0b7283733d4b334d0089ff, ASSIGN in 351 msec 2023-03-30 16:54:10,804 DEBUG [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family2 2023-03-30 16:54:10,805 DEBUG [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family2 2023-03-30 16:54:10,806 INFO [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 800b35d7d26b9866a6511c5f834c181c columnFamilyName family2 2023-03-30 16:54:10,807 INFO [StoreOpener-800b35d7d26b9866a6511c5f834c181c-1] regionserver.HStore(310): Store=800b35d7d26b9866a6511c5f834c181c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:10,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:54:10,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:54:10,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:10,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 800b35d7d26b9866a6511c5f834c181c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69110063, jitterRate=0.029820188879966736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:54:10,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 800b35d7d26b9866a6511c5f834c181c: 2023-03-30 16:54:10,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c., pid=33, masterSystemTime=1680195250758 2023-03-30 16:54:10,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:10,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:10,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:10,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dac04c396edf38306458db05404e6c7d, NAME => 'testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d.', STARTKEY => '1', ENDKEY => '2'} 2023-03-30 16:54:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,820 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=800b35d7d26b9866a6511c5f834c181c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:10,820 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680195250820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195250820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195250820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195250820"}]},"ts":"1680195250820"} 2023-03-30 16:54:10,821 INFO [StoreOpener-dac04c396edf38306458db05404e6c7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,823 DEBUG [StoreOpener-dac04c396edf38306458db05404e6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d/family1 2023-03-30 16:54:10,824 DEBUG [StoreOpener-dac04c396edf38306458db05404e6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d/family1 2023-03-30 16:54:10,824 INFO [StoreOpener-dac04c396edf38306458db05404e6c7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dac04c396edf38306458db05404e6c7d columnFamilyName family1 2023-03-30 16:54:10,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-03-30 16:54:10,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 800b35d7d26b9866a6511c5f834c181c, server=jenkins-hbase4.apache.org,39029,1680195214375 in 217 msec 2023-03-30 16:54:10,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=800b35d7d26b9866a6511c5f834c181c, ASSIGN in 381 msec 2023-03-30 16:54:10,829 INFO [StoreOpener-dac04c396edf38306458db05404e6c7d-1] regionserver.HStore(310): Store=dac04c396edf38306458db05404e6c7d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:10,830 INFO [StoreOpener-dac04c396edf38306458db05404e6c7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,831 DEBUG [StoreOpener-dac04c396edf38306458db05404e6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d/family2 2023-03-30 16:54:10,831 DEBUG [StoreOpener-dac04c396edf38306458db05404e6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d/family2 2023-03-30 16:54:10,832 INFO [StoreOpener-dac04c396edf38306458db05404e6c7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dac04c396edf38306458db05404e6c7d columnFamilyName family2 2023-03-30 16:54:10,833 INFO [StoreOpener-dac04c396edf38306458db05404e6c7d-1] regionserver.HStore(310): Store=dac04c396edf38306458db05404e6c7d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:10,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:54:10,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dac04c396edf38306458db05404e6c7d 2023-03-30 16:54:10,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:10,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dac04c396edf38306458db05404e6c7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59298452, jitterRate=-0.11638420820236206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:54:10,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dac04c396edf38306458db05404e6c7d: 2023-03-30 16:54:10,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d., pid=31, masterSystemTime=1680195250758 2023-03-30 16:54:10,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:10,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:10,852 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=dac04c396edf38306458db05404e6c7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:10,852 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680195250852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195250852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195250852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195250852"}]},"ts":"1680195250852"} 2023-03-30 16:54:10,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-03-30 16:54:10,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure dac04c396edf38306458db05404e6c7d, server=jenkins-hbase4.apache.org,39029,1680195214375 in 252 msec 2023-03-30 16:54:10,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-03-30 16:54:10,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dac04c396edf38306458db05404e6c7d, ASSIGN in 416 msec 2023-03-30 16:54:10,863 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:54:10,863 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195250863"}]},"ts":"1680195250863"} 2023-03-30 16:54:10,865 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-30 16:54:10,868 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:54:10,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 937 msec 2023-03-30 16:54:11,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-30 16:54:11,050 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-30 16:54:11,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:11,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,059 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-30 16:54:11,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:11,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-30 16:54:11,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-30 16:54:11,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,062 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:11,062 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:11,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:11,062 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,062 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:11,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:11,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-30 16:54:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-30 16:54:11,064 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:11,064 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. started... 2023-03-30 16:54:11,064 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:11,064 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. started... 2023-03-30 16:54:11,065 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:54:11,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:11,065 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:11,065 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 800b35d7d26b9866a6511c5f834c181c 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-30 16:54:11,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dac04c396edf38306458db05404e6c7d: 2023-03-30 16:54:11,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. started... 2023-03-30 16:54:11,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:54:11,066 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 311a5d950d0b7283733d4b334d0089ff: 2023-03-30 16:54:11,066 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:11,067 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:54:11,485 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303305fdb81896c80485fb5d3127406dc4b5e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303305fdb81896c80485fb5d3127406dc4b5e 2023-03-30 16:54:11,911 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/.tmp/family1/83fbab6d6175432385f6dccea6f70933 2023-03-30 16:54:11,917 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/.tmp/family1/83fbab6d6175432385f6dccea6f70933 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/83fbab6d6175432385f6dccea6f70933 2023-03-30 16:54:11,922 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/83fbab6d6175432385f6dccea6f70933, entries=1, sequenceid=5, filesize=4.9 K 2023-03-30 16:54:11,923 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 800b35d7d26b9866a6511c5f834c181c in 858ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:11,923 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-30 16:54:11,924 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 800b35d7d26b9866a6511c5f834c181c: 2023-03-30 16:54:11,924 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:54:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:54:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-30 16:54:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-30 16:54:11,926 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,926 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:11,926 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,926 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-30 16:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13d4eea6[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:11,928 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-30 16:54:11,928 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,929 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,929 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-30 16:54:11,929 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-30 16:54:11,929 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:11,930 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,930 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:11,931 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,931 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-30 16:54:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:11,931 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:11,931 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-30 16:54:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:11,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-30 16:54:11,934 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-30 16:54:11,934 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:11,934 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:11,935 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,935 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:11,937 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,937 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,937 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:11,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:11,938 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,939 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,944 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:11,944 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:11,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-30 16:54:11,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:11,944 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:11,944 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:11,944 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-30 16:54:11,944 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,945 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:11,945 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:11,945 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:11,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:11,945 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,945 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:11,945 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,045 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:12,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:12,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:12,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:12,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,058 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-30 16:54:12,058 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:12,058 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-30 16:54:12,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-30 16:54:12,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,059 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,060 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:12,060 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:12,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:12,061 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,061 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:12,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:12,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,062 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-30 16:54:12,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,062 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-30 16:54:12,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:12,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-30 16:54:12,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:12,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. started... 2023-03-30 16:54:12,065 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 800b35d7d26b9866a6511c5f834c181c 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-30 16:54:12,080 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:12,080 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. started... 2023-03-30 16:54:12,080 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dac04c396edf38306458db05404e6c7d: 2023-03-30 16:54:12,080 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:54:12,080 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:54:12,080 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:12,080 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:12,080 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. started... 2023-03-30 16:54:12,080 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:54:12,081 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 311a5d950d0b7283733d4b334d0089ff: 2023-03-30 16:54:12,081 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:54:12,081 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:54:12,095 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330222bfa0c81214e3f96a7be0572d493bd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230330222bfa0c81214e3f96a7be0572d493bd 2023-03-30 16:54:12,107 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/.tmp/family1/c33b10582d1242bb994b801fdec11544 2023-03-30 16:54:12,113 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/.tmp/family1/c33b10582d1242bb994b801fdec11544 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/c33b10582d1242bb994b801fdec11544 2023-03-30 16:54:12,118 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/c33b10582d1242bb994b801fdec11544, entries=2, sequenceid=9, filesize=5.0 K 2023-03-30 16:54:12,119 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 800b35d7d26b9866a6511c5f834c181c in 54ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:12,120 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 800b35d7d26b9866a6511c5f834c181c: 2023-03-30 16:54:12,120 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:12,120 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:54:12,120 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:54:12,120 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,121 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-30 16:54:12,121 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-30 16:54:12,122 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:12,124 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,124 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,124 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-30 16:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57a887de[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:12,126 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-30 16:54:12,126 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,128 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,128 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-30 16:54:12,128 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-30 16:54:12,128 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:12,129 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,129 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:12,131 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,131 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-30 16:54:12,131 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:12,131 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-30 16:54:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:12,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:12,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-30 16:54:12,135 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-30 16:54:12,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:12,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:12,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,135 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:12,138 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,138 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:12,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,138 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:12,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:12,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:12,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:12,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:12,139 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:12,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,141 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:12,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:12,145 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,145 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-30 16:54:12,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:12,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:12,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:12,146 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:12,146 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:12,246 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:12,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:12,258 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-30 16:54:12,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-30 16:54:12,261 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-30 16:54:12,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:12,272 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195852272 2023-03-30 16:54:12,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:12,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-30 16:54:12,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-30 16:54:12,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x140f3b5a to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:12,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d59c71f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:12,306 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230330 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-30 16:54:12,398 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033029c832c856024d5589fea2d7729b058f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023033029c832c856024d5589fea2d7729b058f 2023-03-30 16:54:12,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-30 16:54:12,418 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:12,419 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36582, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:12,438 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:12,441 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50010, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:12,469 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230330/family1/0bc30860290e462680f4c6f8affcad39 first=Optional[k0] last=Optional[k1] 2023-03-30 16:54:12,470 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230330/family1/0bc30860290e462680f4c6f8affcad39}] 2023-03-30 16:54:12,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230330/family1/0bc30860290e462680f4c6f8affcad39 for inclusion in 800b35d7d26b9866a6511c5f834c181c/family1 2023-03-30 16:54:12,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-30 16:54:12,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-30 16:54:12,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 800b35d7d26b9866a6511c5f834c181c: 2023-03-30 16:54:12,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230330/family1/0bc30860290e462680f4c6f8affcad39 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testScannerOnBulkLoadRefHFiles__5k1b2b1tuscrcgdsjm3gi2jmahi9a34m4v66tqtpieum444mth01006rghjg9lg0/family1/0bc30860290e462680f4c6f8affcad39 2023-03-30 16:54:12,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testScannerOnBulkLoadRefHFiles__5k1b2b1tuscrcgdsjm3gi2jmahi9a34m4v66tqtpieum444mth01006rghjg9lg0/family1/0bc30860290e462680f4c6f8affcad39 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_ 2023-03-30 16:54:12,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testScannerOnBulkLoadRefHFiles__5k1b2b1tuscrcgdsjm3gi2jmahi9a34m4v66tqtpieum444mth01006rghjg9lg0/family1/0bc30860290e462680f4c6f8affcad39 into 800b35d7d26b9866a6511c5f834c181c/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_ - updating store file list. 2023-03-30 16:54:12,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_ into 800b35d7d26b9866a6511c5f834c181c/family1 2023-03-30 16:54:12,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testScannerOnBulkLoadRefHFiles__5k1b2b1tuscrcgdsjm3gi2jmahi9a34m4v66tqtpieum444mth01006rghjg9lg0/family1/0bc30860290e462680f4c6f8affcad39 into 800b35d7d26b9866a6511c5f834c181c/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_) 2023-03-30 16:54:12,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testScannerOnBulkLoadRefHFiles__5k1b2b1tuscrcgdsjm3gi2jmahi9a34m4v66tqtpieum444mth01006rghjg9lg0/family1/0bc30860290e462680f4c6f8affcad39 2023-03-30 16:54:12,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-30 16:54:12,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-30 16:54:12,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): 800b35d7d26b9866a6511c5f834c181c/family1 is initiating minor compaction (all files) 2023-03-30 16:54:12,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@29d22c6e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:12,513 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 800b35d7d26b9866a6511c5f834c181c/family1 in testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:54:12,513 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/83fbab6d6175432385f6dccea6f70933, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/c33b10582d1242bb994b801fdec11544, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/.tmp, totalSize=15.1 K 2023-03-30 16:54:12,514 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 83fbab6d6175432385f6dccea6f70933, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195251050 2023-03-30 16:54:12,515 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting c33b10582d1242bb994b801fdec11544, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195251050 2023-03-30 16:54:12,515 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195251050 2023-03-30 16:54:12,516 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-30 16:54:12,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:12,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230330222bfa0c81214e3f96a7be0572d493bd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230330222bfa0c81214e3f96a7be0572d493bd 2023-03-30 16:54:12,531 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303305fdb81896c80485fb5d3127406dc4b5e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303305fdb81896c80485fb5d3127406dc4b5e 2023-03-30 16:54:12,531 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-30 16:54:12,531 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230330' 2023-03-30 16:54:12,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230330 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-30 16:54:12,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-30 16:54:12,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:12,533 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-30 16:54:12,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 274 msec 2023-03-30 16:54:12,547 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 800b35d7d26b9866a6511c5f834c181c#family1#compaction#38 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:12,574 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=261 (was 251) - Thread LEAK? -, OpenFileDescriptor=598 (was 592) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 409), ProcessCount=169 (was 169), AvailableMemoryMB=4794 (was 4813) 2023-03-30 16:54:12,591 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=602, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=169, AvailableMemoryMB=4793 2023-03-30 16:54:12,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-30 16:54:12,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:12,597 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/.tmp/family1/dcb2cc17fbda4943b1ccd7fac3b1ebe3 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/dcb2cc17fbda4943b1ccd7fac3b1ebe3 2023-03-30 16:54:12,598 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:54:12,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-30 16:54:12,599 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:54:12,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-30 16:54:12,601 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:12,602 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156 empty. 2023-03-30 16:54:12,603 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:12,603 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-30 16:54:12,605 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 800b35d7d26b9866a6511c5f834c181c/family1 of 800b35d7d26b9866a6511c5f834c181c into dcb2cc17fbda4943b1ccd7fac3b1ebe3(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:12,605 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 800b35d7d26b9866a6511c5f834c181c: 2023-03-30 16:54:12,606 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1680195252513; duration=0sec 2023-03-30 16:54:12,606 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:12,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/83fbab6d6175432385f6dccea6f70933, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/c33b10582d1242bb994b801fdec11544, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_] to archive 2023-03-30 16:54:12,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:12,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/83fbab6d6175432385f6dccea6f70933 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/83fbab6d6175432385f6dccea6f70933 2023-03-30 16:54:12,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/c33b10582d1242bb994b801fdec11544 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/c33b10582d1242bb994b801fdec11544 2023-03-30 16:54:12,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/family1/693d4c2803eb4c48b2f7089e45b89ed5_SeqId_12_ 2023-03-30 16:54:12,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-30 16:54:12,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-30 16:54:13,024 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:13,025 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6b6ff4ad9c20b14af117117618318156, NAME => 'testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:13,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-30 16:54:13,448 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:13,448 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 6b6ff4ad9c20b14af117117618318156, disabling compactions & flushes 2023-03-30 16:54:13,448 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:13,448 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:13,448 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. after waiting 0 ms 2023-03-30 16:54:13,448 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:13,449 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:13,449 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:13,452 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:54:13,452 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680195253452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195253452"}]},"ts":"1680195253452"} 2023-03-30 16:54:13,454 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:54:13,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:54:13,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195253455"}]},"ts":"1680195253455"} 2023-03-30 16:54:13,457 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-30 16:54:13,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6b6ff4ad9c20b14af117117618318156, ASSIGN}] 2023-03-30 16:54:13,467 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6b6ff4ad9c20b14af117117618318156, ASSIGN 2023-03-30 16:54:13,468 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6b6ff4ad9c20b14af117117618318156, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:13,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6b6ff4ad9c20b14af117117618318156, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:13,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680195253619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195253619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195253619"}]},"ts":"1680195253619"} 2023-03-30 16:54:13,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 6b6ff4ad9c20b14af117117618318156, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:13,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-30 16:54:13,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:13,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6b6ff4ad9c20b14af117117618318156, NAME => 'testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:13,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:13,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:13,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:13,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:13,779 INFO [StoreOpener-6b6ff4ad9c20b14af117117618318156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:13,781 DEBUG [StoreOpener-6b6ff4ad9c20b14af117117618318156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1 2023-03-30 16:54:13,781 DEBUG [StoreOpener-6b6ff4ad9c20b14af117117618318156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1 2023-03-30 16:54:13,781 INFO [StoreOpener-6b6ff4ad9c20b14af117117618318156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b6ff4ad9c20b14af117117618318156 columnFamilyName family1 2023-03-30 16:54:13,783 INFO [StoreOpener-6b6ff4ad9c20b14af117117618318156-1] regionserver.HStore(310): Store=6b6ff4ad9c20b14af117117618318156/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:13,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:13,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:13,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6b6ff4ad9c20b14af117117618318156 2023-03-30 16:54:13,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:13,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6b6ff4ad9c20b14af117117618318156; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60711526, jitterRate=-0.09532776474952698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:13,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:13,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156., pid=37, masterSystemTime=1680195253773 2023-03-30 16:54:13,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:13,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:13,794 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6b6ff4ad9c20b14af117117618318156, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:13,795 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680195253794"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195253794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195253794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195253794"}]},"ts":"1680195253794"} 2023-03-30 16:54:13,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-30 16:54:13,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 6b6ff4ad9c20b14af117117618318156, server=jenkins-hbase4.apache.org,39029,1680195214375 in 175 msec 2023-03-30 16:54:13,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-30 16:54:13,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6b6ff4ad9c20b14af117117618318156, ASSIGN in 334 msec 2023-03-30 16:54:13,801 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:54:13,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195253801"}]},"ts":"1680195253801"} 2023-03-30 16:54:13,803 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-30 16:54:13,805 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:54:13,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.2120 sec 2023-03-30 16:54:14,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-30 16:54:14,706 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-30 16:54:14,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:14,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,740 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:14,740 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:14,740 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:14,740 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:14,740 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,741 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,742 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:14,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:14,742 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:14,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,743 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:14,743 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:14,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:14,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,744 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,744 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:14,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:14,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:14,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:14,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:14,745 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:14,746 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:14,746 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:14,746 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-30 16:54:15,216 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309bc1275a3b8148f3add099d7350ebd01 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511309bc1275a3b8148f3add099d7350ebd01 2023-03-30 16:54:15,620 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/27947d090bb14527b9a8a00cce321eef 2023-03-30 16:54:15,626 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/27947d090bb14527b9a8a00cce321eef as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/27947d090bb14527b9a8a00cce321eef 2023-03-30 16:54:15,631 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/27947d090bb14527b9a8a00cce321eef, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-30 16:54:15,632 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 886ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:15,632 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:15,632 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:15,632 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:15,632 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:15,632 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:15,632 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,632 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:15,633 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:15,635 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,635 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:15,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:15,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:15,636 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,636 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:15,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:15,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:15,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:15,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cfba9eb[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:15,637 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:15,637 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,638 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,638 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:15,638 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:15,638 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:15,638 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,639 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:15,640 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:15,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:15,642 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:15,643 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:15,643 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:15,643 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,643 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:15,644 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,644 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,644 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:15,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:15,645 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,650 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,650 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,650 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:15,650 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:15,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:15,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:15,650 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:15,650 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:15,650 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:15,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:15,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:15,650 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,651 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:15,651 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,651 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,651 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:15,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:15,751 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:15,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:15,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:15,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:15,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,766 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:15,766 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:15,766 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:15,766 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:15,767 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,767 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,769 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:15,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:15,769 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,771 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,771 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,773 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,776 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:15,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,776 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:15,776 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:15,776 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:15,789 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:15,789 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:15,789 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:15,789 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:15,789 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-30 16:54:15,838 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112811d02d5989314a13b5fa76e31ce810a6 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112811d02d5989314a13b5fa76e31ce810a6 2023-03-30 16:54:15,862 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/dc264298fd4342978d8ad78d24f6c3fd 2023-03-30 16:54:15,868 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/dc264298fd4342978d8ad78d24f6c3fd as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/dc264298fd4342978d8ad78d24f6c3fd 2023-03-30 16:54:15,873 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/dc264298fd4342978d8ad78d24f6c3fd, entries=1, sequenceid=9, filesize=5.0 K 2023-03-30 16:54:15,874 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 85ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:15,874 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:15,874 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:15,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:15,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:15,876 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:15,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:15,877 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,877 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:15,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:15,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:15,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:15,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:15,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56cc86a9[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:15,879 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:15,879 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,885 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:15,885 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,885 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:15,887 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:15,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:15,891 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:15,891 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:15,891 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:15,891 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,891 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:15,896 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,896 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:15,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,897 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:15,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:15,898 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,902 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,904 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,904 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,904 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,904 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:15,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:15,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:15,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:15,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:15,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:15,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:15,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,905 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:15,905 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:15,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:15,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:15,906 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:15,906 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:16,006 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:16,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:16,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:16,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:16,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,014 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:16,014 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:16,014 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:16,014 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:16,014 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,014 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,016 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:16,016 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:16,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:16,017 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,017 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:16,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:16,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,018 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,018 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:16,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,018 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:16,018 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:16,018 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:16,018 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:16,018 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:16,018 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:16,018 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:16,018 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:16,318 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:54:16,437 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010d1e3af58bc74e9f9c55c48e35dd9aa2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512010d1e3af58bc74e9f9c55c48e35dd9aa2 2023-03-30 16:54:16,844 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/7d639085fe374bf6a6a2947ad3dfa14c 2023-03-30 16:54:16,851 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/7d639085fe374bf6a6a2947ad3dfa14c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7d639085fe374bf6a6a2947ad3dfa14c 2023-03-30 16:54:16,856 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7d639085fe374bf6a6a2947ad3dfa14c, entries=1, sequenceid=13, filesize=4.9 K 2023-03-30 16:54:16,858 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 839ms, sequenceid=13, compaction requested=true 2023-03-30 16:54:16,858 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:16,858 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:16,860 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,861 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6259e308[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:16,862 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:16,862 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,864 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:16,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,864 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:16,866 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:16,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:16,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:16,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:16,869 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:16,869 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:16,869 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:16,869 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,869 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:16,871 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,872 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,872 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:16,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:16,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:16,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:16,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:16,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:16,873 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,874 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,876 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,877 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:16,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:16,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:16,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:16,877 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:16,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:16,978 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:16,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:16,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:16,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:16,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,986 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:16,986 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:16,986 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:16,986 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:16,986 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,986 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:16,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:16,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:16,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:16,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:16,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,990 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,990 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:16,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:16,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:16,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:16,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:16,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:16,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:16,990 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:16,991 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:16,991 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:17,022 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053ca3e3c79c0b4fc38dbdf5bda10cd0e8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053ca3e3c79c0b4fc38dbdf5bda10cd0e8 2023-03-30 16:54:17,434 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/9d19b66b174b45eba0bc36c7ddcf24c3 2023-03-30 16:54:17,440 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/9d19b66b174b45eba0bc36c7ddcf24c3 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/9d19b66b174b45eba0bc36c7ddcf24c3 2023-03-30 16:54:17,448 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/9d19b66b174b45eba0bc36c7ddcf24c3, entries=1, sequenceid=17, filesize=4.9 K 2023-03-30 16:54:17,449 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 458ms, sequenceid=17, compaction requested=true 2023-03-30 16:54:17,449 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:17,449 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:17,449 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:17,449 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:17,449 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,449 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:17,449 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:17,451 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:17,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71dc1eea[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:17,453 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:17,453 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,454 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:17,454 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,454 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:17,456 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:17,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:17,459 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:17,459 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:17,459 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:17,459 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,459 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:17,462 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,462 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,462 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,463 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,464 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,466 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,467 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,467 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:17,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:17,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:17,467 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:17,467 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:17,467 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:17,467 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:17,467 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:17,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:17,467 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:17,468 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:17,468 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,468 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,567 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:17,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:17,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:17,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:17,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,575 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:17,575 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:17,575 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:17,575 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:17,575 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,575 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,577 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:17,577 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:17,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:17,577 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,577 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:17,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:17,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,578 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,578 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:17,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:17,578 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:17,578 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:17,578 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:17,592 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d0a7b9db1f084b98b428bdf08e4016a8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228d0a7b9db1f084b98b428bdf08e4016a8 2023-03-30 16:54:17,604 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/f8acad2819684655aa5f0ce582f3607f 2023-03-30 16:54:17,609 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/f8acad2819684655aa5f0ce582f3607f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8acad2819684655aa5f0ce582f3607f 2023-03-30 16:54:17,614 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8acad2819684655aa5f0ce582f3607f, entries=1, sequenceid=21, filesize=4.9 K 2023-03-30 16:54:17,615 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 37ms, sequenceid=21, compaction requested=true 2023-03-30 16:54:17,615 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:17,615 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:17,615 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:17,615 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:17,615 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,615 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:17,615 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:17,620 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,620 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,620 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,620 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:17,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30a945cb[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:17,622 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:17,622 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,623 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:17,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:17,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:17,623 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,623 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:17,624 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:17,625 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:17,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,625 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:17,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:17,627 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:17,627 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:17,627 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:17,627 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,627 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:17,629 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,629 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,629 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:17,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:17,629 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,630 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,633 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,633 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,633 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,633 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,634 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:17,633 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:17,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:17,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:17,634 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:17,634 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:17,634 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,634 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:17,634 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:17,634 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:17,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:17,734 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:17,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:17,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:17,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:17,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,743 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:17,743 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:17,743 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:17,743 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:17,744 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,744 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,746 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,746 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:17,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:17,747 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,747 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:17,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,755 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:17,755 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:17,755 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:17,757 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:17,758 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:17,758 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:17,758 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:17,758 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:17,774 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d2c0197937be434c974691a858755c2b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2c0197937be434c974691a858755c2b 2023-03-30 16:54:17,783 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/68c8c0cacbe0469e817561aa66955459 2023-03-30 16:54:17,788 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/68c8c0cacbe0469e817561aa66955459 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/68c8c0cacbe0469e817561aa66955459 2023-03-30 16:54:17,793 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/68c8c0cacbe0469e817561aa66955459, entries=1, sequenceid=25, filesize=4.9 K 2023-03-30 16:54:17,794 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 36ms, sequenceid=25, compaction requested=true 2023-03-30 16:54:17,794 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:17,794 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:17,794 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:17,794 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:17,794 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,794 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:17,794 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:17,796 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,796 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:17,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e274b9[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:17,799 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:17,799 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,800 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,800 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:17,801 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:17,801 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:17,801 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,801 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:17,803 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:17,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:17,807 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:17,807 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:17,807 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:17,807 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,807 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:17,808 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,808 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,808 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:17,809 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,810 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,812 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,812 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:17,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:17,813 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:17,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:17,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:17,813 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:17,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:17,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:17,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:17,913 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:17,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:17,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:17,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:17,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,922 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:17,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:17,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:17,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:17,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,922 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,924 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:17,924 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:17,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,925 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:17,925 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:17,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:17,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,925 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,925 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:17,925 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:17,925 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:17,926 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:17,926 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:17,926 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:17,926 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:17,942 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010103485c5851b2416b871486e3dfc2d0d7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010103485c5851b2416b871486e3dfc2d0d7 2023-03-30 16:54:18,349 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/8a3978c1e5b044a3967d66cc0487fec6 2023-03-30 16:54:18,355 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/8a3978c1e5b044a3967d66cc0487fec6 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/8a3978c1e5b044a3967d66cc0487fec6 2023-03-30 16:54:18,363 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/8a3978c1e5b044a3967d66cc0487fec6, entries=1, sequenceid=29, filesize=4.9 K 2023-03-30 16:54:18,364 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 438ms, sequenceid=29, compaction requested=true 2023-03-30 16:54:18,364 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:18,365 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:18,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:18,368 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:18,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:18,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f8e864e[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:18,370 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:18,370 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,372 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,372 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:18,372 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:18,372 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:18,373 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,373 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:18,374 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:18,374 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:18,374 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,374 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:18,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:18,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:18,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:18,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:18,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:18,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:18,377 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:18,377 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:18,377 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:18,377 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,377 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:18,379 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,379 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:18,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,379 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:18,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:18,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:18,384 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:18,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,386 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,390 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,390 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,390 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:18,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:18,390 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:18,390 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:18,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-30 16:54:18,390 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:18,390 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:18,391 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:18,391 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:18,391 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,391 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,391 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:18,491 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:18,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:18,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:18,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:18,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,498 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:18,498 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:18,499 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:18,499 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:18,499 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,499 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,503 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,503 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:18,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:18,503 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:18,503 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:18,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,504 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:18,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:18,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:18,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:18,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:18,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:18,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:18,505 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:18,505 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:18,505 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:18,935 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010385fd11894dae412fa69d01fd8d9b3357 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010385fd11894dae412fa69d01fd8d9b3357 2023-03-30 16:54:19,341 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/7aeac496406a4e27a19d9d9a68f57d84 2023-03-30 16:54:19,348 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/7aeac496406a4e27a19d9d9a68f57d84 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7aeac496406a4e27a19d9d9a68f57d84 2023-03-30 16:54:19,353 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7aeac496406a4e27a19d9d9a68f57d84, entries=1, sequenceid=33, filesize=4.9 K 2023-03-30 16:54:19,359 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 854ms, sequenceid=33, compaction requested=true 2023-03-30 16:54:19,359 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:19,359 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:19,361 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:19,361 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:19,361 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,361 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:19,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:19,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:19,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:19,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:19,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eb4f61b[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:19,363 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:19,363 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,365 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:19,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:19,365 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:19,365 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,365 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:19,366 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:19,366 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,366 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:19,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:19,366 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:19,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:19,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:19,369 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:19,369 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:19,369 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:19,369 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,369 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:19,372 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,372 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:19,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,372 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:19,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:19,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:19,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:19,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:19,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,373 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:19,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,374 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:19,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:19,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,377 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:19,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:19,377 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:19,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:19,378 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:19,378 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:19,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:19,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:19,478 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:19,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:19,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:19,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:19,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,500 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:19,500 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:19,501 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:19,501 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:19,501 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,501 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,502 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:19,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,503 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,504 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:19,504 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,504 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,504 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:19,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:19,514 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:19,515 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:19,515 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:19,940 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907bc5dc96833fe412fbe6c0d35420164e2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907bc5dc96833fe412fbe6c0d35420164e2 2023-03-30 16:54:20,354 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/2f94378f830a433d8b93a29a911f1b63 2023-03-30 16:54:20,359 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/2f94378f830a433d8b93a29a911f1b63 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/2f94378f830a433d8b93a29a911f1b63 2023-03-30 16:54:20,366 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/2f94378f830a433d8b93a29a911f1b63, entries=1, sequenceid=37, filesize=4.9 K 2023-03-30 16:54:20,367 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 852ms, sequenceid=37, compaction requested=true 2023-03-30 16:54:20,367 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:20,367 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:20,368 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:20,369 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:20,370 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,370 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:20,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:20,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44497b1b[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:20,371 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:20,371 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,373 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,373 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:20,373 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:20,373 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:20,373 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,373 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:20,374 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:20,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,377 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:20,377 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:20,377 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:20,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:20,378 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:20,378 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:20,378 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:20,378 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,378 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:20,381 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,381 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:20,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:20,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,381 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:20,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:20,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:20,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:20,382 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:20,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,383 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:20,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:20,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:20,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:20,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:20,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:20,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:20,385 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:20,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,386 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,386 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,386 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,386 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,386 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:20,386 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:20,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:20,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:20,486 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:20,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:20,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:20,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:20,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,494 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:20,494 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:20,494 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-30 16:54:20,494 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-30 16:54:20,495 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,495 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,497 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:20,497 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:20,497 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,497 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:20,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,498 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,498 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-30 16:54:20,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-30 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-30 16:54:20,499 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:20,499 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:20,499 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:20,499 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. started... 2023-03-30 16:54:20,499 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6b6ff4ad9c20b14af117117618318156 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:20,927 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e96120eaaff3484487814d97024a62b9 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120e96120eaaff3484487814d97024a62b9 2023-03-30 16:54:20,934 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/5d295fdb4dc94bd384d1add22ef52c06 2023-03-30 16:54:20,941 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/5d295fdb4dc94bd384d1add22ef52c06 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/5d295fdb4dc94bd384d1add22ef52c06 2023-03-30 16:54:20,946 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/5d295fdb4dc94bd384d1add22ef52c06, entries=1, sequenceid=41, filesize=4.9 K 2023-03-30 16:54:20,947 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6b6ff4ad9c20b14af117117618318156 in 448ms, sequenceid=41, compaction requested=true 2023-03-30 16:54:20,947 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:20,947 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:20,947 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:20,947 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:20,947 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,947 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-30 16:54:20,947 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-30 16:54:20,949 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:20,950 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:20,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-30 16:54:20,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@559f9897[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:20,952 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-30 16:54:20,952 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,953 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-30 16:54:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-30 16:54:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:20,953 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,953 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-30 16:54:20,955 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-30 16:54:20,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:20,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:20,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:54:20,959 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-30 16:54:20,959 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:20,959 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:20,959 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,959 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:20,961 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,961 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,961 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:20,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,963 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,964 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:20,969 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:20,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-30 16:54:20,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,969 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:20,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:20,970 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:20,970 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:20,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:21,070 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:21,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:21,072 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-30 16:54:21,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:54:21,075 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:54:21,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:21,076 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195861076 2023-03-30 16:54:21,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:21,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-30 16:54:21,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:21,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x2dc10c80 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:21,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e735718, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:21,102 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:21,976 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010312538bec1e7c47c9a080b33d2da6876d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010312538bec1e7c47c9a080b33d2da6876d 2023-03-30 16:54:21,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:22,000 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:22,001 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:22,012 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:22,013 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48444, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:22,023 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4c20eb454a9a45e886b9e973606c7031 first=Optional[r3] last=Optional[r6] 2023-03-30 16:54:22,023 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4c20eb454a9a45e886b9e973606c7031}] 2023-03-30 16:54:22,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4c20eb454a9a45e886b9e973606c7031 for inclusion in 6b6ff4ad9c20b14af117117618318156/family1 2023-03-30 16:54:22,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-30 16:54:22,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:22,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:22,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4c20eb454a9a45e886b9e973606c7031 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__t8itfghdhndujfeaahaug2mablonb79a52523o5kdpcht5v34l7t0p5qtfbq1em4/family1/4c20eb454a9a45e886b9e973606c7031 2023-03-30 16:54:22,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__t8itfghdhndujfeaahaug2mablonb79a52523o5kdpcht5v34l7t0p5qtfbq1em4/family1/4c20eb454a9a45e886b9e973606c7031 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_ 2023-03-30 16:54:22,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__t8itfghdhndujfeaahaug2mablonb79a52523o5kdpcht5v34l7t0p5qtfbq1em4/family1/4c20eb454a9a45e886b9e973606c7031 into 6b6ff4ad9c20b14af117117618318156/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_ - updating store file list. 2023-03-30 16:54:22,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_ into 6b6ff4ad9c20b14af117117618318156/family1 2023-03-30 16:54:22,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__t8itfghdhndujfeaahaug2mablonb79a52523o5kdpcht5v34l7t0p5qtfbq1em4/family1/4c20eb454a9a45e886b9e973606c7031 into 6b6ff4ad9c20b14af117117618318156/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_) 2023-03-30 16:54:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__t8itfghdhndujfeaahaug2mablonb79a52523o5kdpcht5v34l7t0p5qtfbq1em4/family1/4c20eb454a9a45e886b9e973606c7031 2023-03-30 16:54:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-30 16:54:22,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-30 16:54:22,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): 6b6ff4ad9c20b14af117117618318156/family1 is initiating minor compaction 2023-03-30 16:54:22,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@44520c7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:22,045 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6b6ff4ad9c20b14af117117618318156/family1 in testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:22,045 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/dc264298fd4342978d8ad78d24f6c3fd, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7d639085fe374bf6a6a2947ad3dfa14c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/9d19b66b174b45eba0bc36c7ddcf24c3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8acad2819684655aa5f0ce582f3607f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/68c8c0cacbe0469e817561aa66955459, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/8a3978c1e5b044a3967d66cc0487fec6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7aeac496406a4e27a19d9d9a68f57d84, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/2f94378f830a433d8b93a29a911f1b63, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/5d295fdb4dc94bd384d1add22ef52c06, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp, totalSize=50.0 K 2023-03-30 16:54:22,045 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting dc264298fd4342978d8ad78d24f6c3fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:54:22,045 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 7d639085fe374bf6a6a2947ad3dfa14c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:54:22,045 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 9d19b66b174b45eba0bc36c7ddcf24c3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-30 16:54:22,045 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting f8acad2819684655aa5f0ce582f3607f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-30 16:54:22,046 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 68c8c0cacbe0469e817561aa66955459, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-30 16:54:22,046 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 8a3978c1e5b044a3967d66cc0487fec6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-30 16:54:22,046 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 7aeac496406a4e27a19d9d9a68f57d84, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-30 16:54:22,046 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 2f94378f830a433d8b93a29a911f1b63, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-30 16:54:22,046 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 5d295fdb4dc94bd384d1add22ef52c06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-30 16:54:22,046 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-30 16:54:22,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:22,056 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:22,060 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228d0a7b9db1f084b98b428bdf08e4016a8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228d0a7b9db1f084b98b428bdf08e4016a8 2023-03-30 16:54:22,063 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2c0197937be434c974691a858755c2b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2c0197937be434c974691a858755c2b 2023-03-30 16:54:22,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010103485c5851b2416b871486e3dfc2d0d7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010103485c5851b2416b871486e3dfc2d0d7 2023-03-30 16:54:22,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010385fd11894dae412fa69d01fd8d9b3357 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010385fd11894dae412fa69d01fd8d9b3357 2023-03-30 16:54:22,067 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-30 16:54:22,067 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,098 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6b6ff4ad9c20b14af117117618318156#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:22,542 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/f8d8757343d74829ac82019e7251115c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8d8757343d74829ac82019e7251115c 2023-03-30 16:54:22,548 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6b6ff4ad9c20b14af117117618318156/family1 of 6b6ff4ad9c20b14af117117618318156 into f8d8757343d74829ac82019e7251115c(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:22,548 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:22,549 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1680195262045; duration=0sec 2023-03-30 16:54:22,549 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:22,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/dc264298fd4342978d8ad78d24f6c3fd, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7d639085fe374bf6a6a2947ad3dfa14c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/9d19b66b174b45eba0bc36c7ddcf24c3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8acad2819684655aa5f0ce582f3607f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/68c8c0cacbe0469e817561aa66955459, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/8a3978c1e5b044a3967d66cc0487fec6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7aeac496406a4e27a19d9d9a68f57d84, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/2f94378f830a433d8b93a29a911f1b63, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/5d295fdb4dc94bd384d1add22ef52c06, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_] to archive 2023-03-30 16:54:22,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:22,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/dc264298fd4342978d8ad78d24f6c3fd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/dc264298fd4342978d8ad78d24f6c3fd 2023-03-30 16:54:22,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7d639085fe374bf6a6a2947ad3dfa14c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7d639085fe374bf6a6a2947ad3dfa14c 2023-03-30 16:54:22,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/9d19b66b174b45eba0bc36c7ddcf24c3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/9d19b66b174b45eba0bc36c7ddcf24c3 2023-03-30 16:54:22,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8acad2819684655aa5f0ce582f3607f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8acad2819684655aa5f0ce582f3607f 2023-03-30 16:54:22,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/68c8c0cacbe0469e817561aa66955459 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/68c8c0cacbe0469e817561aa66955459 2023-03-30 16:54:22,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/8a3978c1e5b044a3967d66cc0487fec6 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/8a3978c1e5b044a3967d66cc0487fec6 2023-03-30 16:54:22,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7aeac496406a4e27a19d9d9a68f57d84 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/7aeac496406a4e27a19d9d9a68f57d84 2023-03-30 16:54:22,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/2f94378f830a433d8b93a29a911f1b63 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/2f94378f830a433d8b93a29a911f1b63 2023-03-30 16:54:22,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/5d295fdb4dc94bd384d1add22ef52c06 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/5d295fdb4dc94bd384d1add22ef52c06 2023-03-30 16:54:22,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/e33211c6275b40f0a7cc5e7c8a89053d_SeqId_44_ 2023-03-30 16:54:22,583 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c3619ebfba4d4a4fb246d28c441011fe to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c3619ebfba4d4a4fb246d28c441011fe 2023-03-30 16:54:22,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:22,619 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/190e45958d0944858221331b8fdd177e first=Optional[r00] last=Optional[r2] 2023-03-30 16:54:22,619 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/190e45958d0944858221331b8fdd177e}] 2023-03-30 16:54:22,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/190e45958d0944858221331b8fdd177e for inclusion in 6b6ff4ad9c20b14af117117618318156/family1 2023-03-30 16:54:22,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-30 16:54:22,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:22,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:22,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/190e45958d0944858221331b8fdd177e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__a0jfjdb8vef4rnqqpb4r0cuk4fg4he5hibpso7pu4u7m2f750j4opoq1f8j1bfqn/family1/190e45958d0944858221331b8fdd177e 2023-03-30 16:54:22,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__a0jfjdb8vef4rnqqpb4r0cuk4fg4he5hibpso7pu4u7m2f750j4opoq1f8j1bfqn/family1/190e45958d0944858221331b8fdd177e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_ 2023-03-30 16:54:22,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__a0jfjdb8vef4rnqqpb4r0cuk4fg4he5hibpso7pu4u7m2f750j4opoq1f8j1bfqn/family1/190e45958d0944858221331b8fdd177e into 6b6ff4ad9c20b14af117117618318156/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_ - updating store file list. 2023-03-30 16:54:22,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_ into 6b6ff4ad9c20b14af117117618318156/family1 2023-03-30 16:54:22,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__a0jfjdb8vef4rnqqpb4r0cuk4fg4he5hibpso7pu4u7m2f750j4opoq1f8j1bfqn/family1/190e45958d0944858221331b8fdd177e into 6b6ff4ad9c20b14af117117618318156/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_) 2023-03-30 16:54:22,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyPolicy__a0jfjdb8vef4rnqqpb4r0cuk4fg4he5hibpso7pu4u7m2f750j4opoq1f8j1bfqn/family1/190e45958d0944858221331b8fdd177e 2023-03-30 16:54:22,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-30 16:54:22,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-30 16:54:22,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): 6b6ff4ad9c20b14af117117618318156/family1 is initiating minor compaction (all files) 2023-03-30 16:54:22,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@295e7339; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:22,637 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6b6ff4ad9c20b14af117117618318156/family1 in testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:54:22,637 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/27947d090bb14527b9a8a00cce321eef, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8d8757343d74829ac82019e7251115c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp, totalSize=337.0 K 2023-03-30 16:54:22,638 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 27947d090bb14527b9a8a00cce321eef, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839396 2023-03-30 16:54:22,638 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting f8d8757343d74829ac82019e7251115c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239396 2023-03-30 16:54:22,638 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839396 2023-03-30 16:54:22,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:22,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:22,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511309bc1275a3b8148f3add099d7350ebd01 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511309bc1275a3b8148f3add099d7350ebd01 2023-03-30 16:54:22,644 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512010d1e3af58bc74e9f9c55c48e35dd9aa2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512010d1e3af58bc74e9f9c55c48e35dd9aa2 2023-03-30 16:54:22,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053ca3e3c79c0b4fc38dbdf5bda10cd0e8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053ca3e3c79c0b4fc38dbdf5bda10cd0e8 2023-03-30 16:54:22,645 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-30 16:54:22,646 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-30 16:54:22,647 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-30 16:54:22,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-30 16:54:22,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:22,648 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:54:22,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.5750 sec 2023-03-30 16:54:22,674 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6b6ff4ad9c20b14af117117618318156#family1#compaction#50 average throughput is 5.73 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:22,742 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/.tmp/family1/26fbea457d5b4c31a8f8781036ef3cae as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/26fbea457d5b4c31a8f8781036ef3cae 2023-03-30 16:54:22,750 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6b6ff4ad9c20b14af117117618318156/family1 of 6b6ff4ad9c20b14af117117618318156 into 26fbea457d5b4c31a8f8781036ef3cae(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:22,750 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:54:22,750 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1680195262637; duration=0sec 2023-03-30 16:54:22,750 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:22,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/27947d090bb14527b9a8a00cce321eef, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8d8757343d74829ac82019e7251115c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_] to archive 2023-03-30 16:54:22,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:22,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/27947d090bb14527b9a8a00cce321eef to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/27947d090bb14527b9a8a00cce321eef 2023-03-30 16:54:22,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8d8757343d74829ac82019e7251115c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/f8d8757343d74829ac82019e7251115c 2023-03-30 16:54:22,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/family1/83b20cd186af4884a63e1bbb60a8bf71_SeqId_47_ 2023-03-30 16:54:22,794 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=256 (was 258), OpenFileDescriptor=620 (was 602) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=422 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4734 (was 4793) 2023-03-30 16:54:22,812 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=256, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=422, ProcessCount=169, AvailableMemoryMB=4734 2023-03-30 16:54:22,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-30 16:54:22,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:22,818 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:54:22,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-30 16:54:22,819 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:54:22,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-30 16:54:22,820 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:22,821 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 empty. 2023-03-30 16:54:22,822 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:22,822 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-30 16:54:22,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-30 16:54:23,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-30 16:54:23,235 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:23,237 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => b31111cc3a5f132de53c40f2d4319373, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:23,244 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:23,244 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing b31111cc3a5f132de53c40f2d4319373, disabling compactions & flushes 2023-03-30 16:54:23,244 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. after waiting 0 ms 2023-03-30 16:54:23,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,245 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:23,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:54:23,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195263248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195263248"}]},"ts":"1680195263248"} 2023-03-30 16:54:23,250 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:54:23,251 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:54:23,251 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195263251"}]},"ts":"1680195263251"} 2023-03-30 16:54:23,252 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-30 16:54:23,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, ASSIGN}] 2023-03-30 16:54:23,259 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, ASSIGN 2023-03-30 16:54:23,260 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:23,412 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:23,412 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195263411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195263411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195263411"}]},"ts":"1680195263411"} 2023-03-30 16:54:23,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:23,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-30 16:54:23,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b31111cc3a5f132de53c40f2d4319373, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:23,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:23,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:23,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:23,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:23,583 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:23,585 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:23,585 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:23,586 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b31111cc3a5f132de53c40f2d4319373 columnFamilyName family1 2023-03-30 16:54:23,587 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(310): Store=b31111cc3a5f132de53c40f2d4319373/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:23,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:23,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:23,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:23,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:23,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b31111cc3a5f132de53c40f2d4319373; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65221057, jitterRate=-0.028130516409873962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:23,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:23,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., pid=41, masterSystemTime=1680195263566 2023-03-30 16:54:23,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:23,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195263599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195263599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195263599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195263599"}]},"ts":"1680195263599"} 2023-03-30 16:54:23,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-30 16:54:23,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375 in 187 msec 2023-03-30 16:54:23,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-30 16:54:23,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, ASSIGN in 345 msec 2023-03-30 16:54:23,606 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:54:23,606 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195263606"}]},"ts":"1680195263606"} 2023-03-30 16:54:23,607 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-30 16:54:23,610 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:54:23,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 795 msec 2023-03-30 16:54:23,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-30 16:54:23,924 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-30 16:54:23,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:23,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,956 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:23,956 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:23,956 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:23,956 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:23,957 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,957 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,958 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:23,958 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:23,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:23,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:23,958 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:23,959 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,959 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,960 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:23,960 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:23,960 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:23,961 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-30 16:54:23,999 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301e173c26edaf491fbe8529fe0fb30640 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511301e173c26edaf491fbe8529fe0fb30640 2023-03-30 16:54:24,004 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/e61363de69fa4d979e892c3949bf849f 2023-03-30 16:54:24,009 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/e61363de69fa4d979e892c3949bf849f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/e61363de69fa4d979e892c3949bf849f 2023-03-30 16:54:24,014 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/e61363de69fa4d979e892c3949bf849f, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-30 16:54:24,015 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 54ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:24,015 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:24,015 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:24,015 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:24,016 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:24,017 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,017 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:24,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:24,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ef8d89c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:24,019 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:24,019 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,022 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:24,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:24,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:24,022 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,022 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:24,023 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:24,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:24,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:24,026 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:24,026 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:24,026 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:24,026 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,026 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:24,028 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,028 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:24,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,028 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:24,028 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,030 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:24,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,032 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,032 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,032 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,032 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:24,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:24,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:24,032 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:24,032 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:24,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:24,032 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:24,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:24,032 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,033 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,033 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:24,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:24,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:24,033 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:24,033 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:24,133 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:24,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:24,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:24,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:24,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,140 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:24,140 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:24,140 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:24,140 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:24,141 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,141 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,143 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:24,143 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:24,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:24,144 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,144 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:24,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:24,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,145 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:24,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,145 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:24,145 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:24,145 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:24,145 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:24,145 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:24,145 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:24,145 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:24,145 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-30 16:54:24,559 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128867ac24a359f45ed998e6883b2035735 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128867ac24a359f45ed998e6883b2035735 2023-03-30 16:54:24,966 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/f1cb449058cf4744bcd9de1c4ee2e916 2023-03-30 16:54:24,973 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/f1cb449058cf4744bcd9de1c4ee2e916 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/f1cb449058cf4744bcd9de1c4ee2e916 2023-03-30 16:54:24,978 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/f1cb449058cf4744bcd9de1c4ee2e916, entries=1, sequenceid=9, filesize=5.0 K 2023-03-30 16:54:24,980 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 835ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:24,980 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:24,980 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:24,980 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:24,981 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:24,981 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,981 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:24,981 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:24,982 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,982 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:24,983 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,983 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:24,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:24,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:24,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17e5e376[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:24,987 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:24,987 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,988 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:24,988 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:24,988 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:24,988 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,988 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:24,990 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:24,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:24,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:24,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:24,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:24,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:24,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:24,994 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:24,994 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:24,994 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:24,994 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,994 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:24,997 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,997 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:24,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:24,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,997 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:24,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:24,998 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:24,999 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:25,004 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:25,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:25,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:25,004 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:25,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:25,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:25,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:25,105 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:25,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:25,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:25,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:25,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,111 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:25,111 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:25,111 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:25,111 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:25,112 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,112 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,114 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:25,114 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:25,114 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,114 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:25,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:25,116 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:25,116 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:25,116 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:25,531 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d1c1b034b27746d5b07e1593fc20c76e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d1c1b034b27746d5b07e1593fc20c76e 2023-03-30 16:54:25,537 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/bf0aeb9028ca46ec95fecc2ebabed14c 2023-03-30 16:54:25,541 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/bf0aeb9028ca46ec95fecc2ebabed14c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/bf0aeb9028ca46ec95fecc2ebabed14c 2023-03-30 16:54:25,545 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/bf0aeb9028ca46ec95fecc2ebabed14c, entries=1, sequenceid=13, filesize=5.0 K 2023-03-30 16:54:25,546 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 430ms, sequenceid=13, compaction requested=true 2023-03-30 16:54:25,546 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:25,546 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:25,546 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:25,546 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:25,546 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,546 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:25,547 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:25,549 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,549 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:25,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:25,550 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,550 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:25,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:25,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:25,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:25,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:25,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18fbc332[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:25,551 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:25,551 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,552 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,553 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:25,553 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:25,553 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:25,553 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,553 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:25,554 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:25,554 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:25,554 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:25,555 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:25,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:25,557 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:25,557 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:25,557 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:25,557 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,557 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:25,559 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,559 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,559 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:25,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:25,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:25,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:25,559 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:25,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:25,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:25,561 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:25,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:25,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:25,565 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:25,566 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:25,565 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:25,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:25,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:25,666 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:25,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:25,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:25,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:25,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,673 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:25,673 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:25,673 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:25,673 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:25,673 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,673 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,674 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:25,674 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:25,675 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,675 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:25,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,676 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,676 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:25,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:25,676 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:25,676 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:25,676 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:25,676 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:25,676 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:25,676 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:25,676 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:25,676 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:26,094 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050d043328365b469e97baa2402a784e21 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512050d043328365b469e97baa2402a784e21 2023-03-30 16:54:26,500 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/1538f17c194845d98c983b7c04652ea8 2023-03-30 16:54:26,506 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/1538f17c194845d98c983b7c04652ea8 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/1538f17c194845d98c983b7c04652ea8 2023-03-30 16:54:26,511 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/1538f17c194845d98c983b7c04652ea8, entries=1, sequenceid=17, filesize=5.0 K 2023-03-30 16:54:26,512 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 836ms, sequenceid=17, compaction requested=true 2023-03-30 16:54:26,512 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:26,512 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:26,512 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:26,512 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:26,512 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,512 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:26,512 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:26,514 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,514 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:26,514 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,514 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:26,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:26,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3109bb9a[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:26,516 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:26,516 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,517 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,518 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:26,518 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:26,519 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:26,519 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,519 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:26,521 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,521 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:26,521 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:26,521 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:26,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:26,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:26,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:26,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:26,525 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:26,525 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:26,525 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:26,525 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,525 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:26,526 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:26,528 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,528 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:26,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:26,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:26,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:26,529 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,530 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,532 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,532 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,532 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,533 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:26,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:26,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:26,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:26,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,533 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,533 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:26,533 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:26,536 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:26,536 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:26,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:26,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:26,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:26,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:26,634 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:26,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:26,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:26,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:26,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,642 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:26,642 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:26,642 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:26,642 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:26,642 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,642 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,643 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,643 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:26,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:26,644 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:26,644 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,645 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,645 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:26,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:26,645 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:26,645 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:26,645 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:26,645 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:26,645 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:26,645 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:26,645 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:26,645 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:27,063 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228261c055dee154210afcbf8267fb805f8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228261c055dee154210afcbf8267fb805f8 2023-03-30 16:54:27,470 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/48a4c504c2ff4d27a93a656fa371a12d 2023-03-30 16:54:27,477 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/48a4c504c2ff4d27a93a656fa371a12d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/48a4c504c2ff4d27a93a656fa371a12d 2023-03-30 16:54:27,482 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/48a4c504c2ff4d27a93a656fa371a12d, entries=1, sequenceid=21, filesize=5.0 K 2023-03-30 16:54:27,483 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 838ms, sequenceid=21, compaction requested=true 2023-03-30 16:54:27,483 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:27,483 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:27,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:27,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:27,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:27,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:27,485 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,485 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:27,486 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,486 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:27,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:27,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@797da91f[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:27,488 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:27,488 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,492 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,492 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:27,492 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:27,492 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:27,493 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,493 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:27,494 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:27,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:27,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:27,502 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:27,502 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:27,502 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:27,502 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,502 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:27,504 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,504 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:27,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,504 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:27,505 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:27,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,508 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:27,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,529 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,529 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,529 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:27,529 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:27,529 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:27,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:27,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:27,529 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:27,529 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,530 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,530 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,530 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,530 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:27,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:27,530 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:27,630 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:27,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:27,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:27,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:27,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,644 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:27,644 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:27,644 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:27,644 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:27,645 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,645 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,646 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:27,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:27,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,647 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:27,647 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:27,648 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:27,652 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:27,652 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:27,652 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:27,652 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:27,652 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:27,675 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231574dcd89a2994b68a7ade955abd4a835 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231574dcd89a2994b68a7ade955abd4a835 2023-03-30 16:54:27,684 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/5a052e6eceb0497082768667aa35f9e3 2023-03-30 16:54:27,689 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/5a052e6eceb0497082768667aa35f9e3 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5a052e6eceb0497082768667aa35f9e3 2023-03-30 16:54:27,693 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5a052e6eceb0497082768667aa35f9e3, entries=1, sequenceid=25, filesize=5.0 K 2023-03-30 16:54:27,694 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 42ms, sequenceid=25, compaction requested=true 2023-03-30 16:54:27,694 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:27,694 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:27,694 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:27,694 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:27,694 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,694 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:27,694 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:27,696 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,696 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:27,697 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,697 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:27,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:27,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@413b1b15[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:27,698 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:27,698 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,699 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:27,700 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,700 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:27,702 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:27,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:27,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:27,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:27,705 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:27,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:27,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:27,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,705 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:27,707 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,707 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:27,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,707 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:27,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:27,708 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,711 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,713 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,713 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:27,713 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,713 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:27,713 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:27,713 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:27,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:27,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:27,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:27,714 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,714 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,714 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,714 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,714 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:27,714 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:27,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:27,814 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:27,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:27,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:27,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:27,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,823 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:27,823 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:27,823 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:27,823 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:27,823 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,823 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,825 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,825 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:27,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:27,825 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:27,825 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,826 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,826 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:27,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:27,826 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:27,826 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:27,826 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:27,827 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:27,827 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:27,827 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:28,240 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101641efc0efcfa43cfbae001d883f6d99b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101641efc0efcfa43cfbae001d883f6d99b 2023-03-30 16:54:28,651 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/16dd4fc254bd4c8cbd03825339726871 2023-03-30 16:54:28,656 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/16dd4fc254bd4c8cbd03825339726871 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/16dd4fc254bd4c8cbd03825339726871 2023-03-30 16:54:28,662 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/16dd4fc254bd4c8cbd03825339726871, entries=1, sequenceid=29, filesize=5.0 K 2023-03-30 16:54:28,663 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 836ms, sequenceid=29, compaction requested=true 2023-03-30 16:54:28,663 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:28,663 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:28,664 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,664 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:28,665 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,665 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:28,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:28,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71fa253[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:28,666 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:28,666 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,667 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,668 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:28,668 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:28,668 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:28,668 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,668 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:28,669 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,669 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:28,669 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:28,670 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:28,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:28,672 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:28,672 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:28,672 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:28,672 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,672 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:28,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,675 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:28,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:28,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:28,676 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,677 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:28,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:28,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:28,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,682 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:28,682 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:28,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:28,783 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:28,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:28,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:28,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:28,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,790 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:28,790 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:28,790 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:28,790 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:28,790 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,790 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,791 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:28,791 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:28,792 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:28,792 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,792 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,793 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:28,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:28,793 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:28,793 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:28,793 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:28,793 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:29,114 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:54:29,208 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103590b4caac44441d5bf253b1f2b116915 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103590b4caac44441d5bf253b1f2b116915 2023-03-30 16:54:29,613 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/5589ef4473eb445489965a742d87557b 2023-03-30 16:54:29,618 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/5589ef4473eb445489965a742d87557b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5589ef4473eb445489965a742d87557b 2023-03-30 16:54:29,622 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5589ef4473eb445489965a742d87557b, entries=1, sequenceid=33, filesize=5.0 K 2023-03-30 16:54:29,623 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 830ms, sequenceid=33, compaction requested=true 2023-03-30 16:54:29,623 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:29,623 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:29,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:29,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:29,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:29,623 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:29,625 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,625 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:29,625 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,625 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:29,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:29,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:29,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:29,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b360c41[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:29,626 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:29,627 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,628 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:29,628 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,628 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:29,629 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:29,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:29,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:29,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:29,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:29,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:29,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:29,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:29,631 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:29,631 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:29,631 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:29,631 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,631 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:29,634 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,634 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,634 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:29,635 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,636 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,638 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,638 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,638 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:29,638 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:29,638 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:29,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:29,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:29,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:29,638 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:29,638 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,639 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,639 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:29,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:29,639 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:29,639 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,639 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:29,739 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:29,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:29,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:29,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:29,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,746 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:29,746 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:29,746 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:29,746 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:29,747 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,747 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,748 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:29,748 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:29,748 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,748 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:29,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,749 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,749 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:29,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:29,749 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:29,749 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:29,749 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:29,754 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:29,754 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:29,754 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:30,166 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a6fd06c22c984856b6fb28956d8fac7e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a6fd06c22c984856b6fb28956d8fac7e 2023-03-30 16:54:30,571 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/fd5d655a4aab48888e2cdd5521e95bcf 2023-03-30 16:54:30,576 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/fd5d655a4aab48888e2cdd5521e95bcf as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/fd5d655a4aab48888e2cdd5521e95bcf 2023-03-30 16:54:30,580 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/fd5d655a4aab48888e2cdd5521e95bcf, entries=1, sequenceid=37, filesize=5.0 K 2023-03-30 16:54:30,581 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 827ms, sequenceid=37, compaction requested=true 2023-03-30 16:54:30,581 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:30,581 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:30,581 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:30,581 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:30,581 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,581 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:30,581 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:30,582 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,583 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:30,583 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,583 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f176769[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:30,584 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:30,584 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,586 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,586 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:30,586 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:30,586 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,586 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:30,586 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:30,588 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,588 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:30,588 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:30,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:30,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:30,588 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:30,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:30,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:30,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:30,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:30,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:30,590 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:30,590 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:30,590 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:30,590 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,590 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:30,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:30,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,592 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:30,592 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,593 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:30,596 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:30,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:30,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:30,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:30,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:30,596 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:30,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:30,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:30,696 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:30,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:30,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:30,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:30,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,705 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:30,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:30,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-30 16:54:30,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-30 16:54:30,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,705 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,710 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,710 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:30,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:30,710 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:30,711 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,711 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,712 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-30 16:54:30,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-30 16:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-30 16:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:30,712 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:30,712 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. started... 2023-03-30 16:54:30,712 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b31111cc3a5f132de53c40f2d4319373 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:31,124 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112026a7cd547e504401930f0429c793adca to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112026a7cd547e504401930f0429c793adca 2023-03-30 16:54:31,530 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/59784c15e648489fac954e53aff579c7 2023-03-30 16:54:31,535 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/59784c15e648489fac954e53aff579c7 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/59784c15e648489fac954e53aff579c7 2023-03-30 16:54:31,540 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/59784c15e648489fac954e53aff579c7, entries=1, sequenceid=41, filesize=5.0 K 2023-03-30 16:54:31,541 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b31111cc3a5f132de53c40f2d4319373 in 829ms, sequenceid=41, compaction requested=true 2023-03-30 16:54:31,541 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:31,541 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:31,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:31,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:31,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-30 16:54:31,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-30 16:54:31,543 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,543 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:31,543 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,543 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:31,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-30 16:54:31,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@766d3a2d[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:31,545 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-30 16:54:31,545 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,546 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-30 16:54:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-30 16:54:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:31,547 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,547 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:31,548 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-30 16:54:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-30 16:54:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:31,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-30 16:54:31,550 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-30 16:54:31,550 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:31,550 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:31,550 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,550 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:31,552 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,552 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,552 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:31,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:31,553 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,554 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,556 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,556 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,556 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:31,556 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:31,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-30 16:54:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:31,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:31,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:31,556 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:31,556 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:31,556 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:31,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:31,557 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:31,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,557 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:31,657 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:31,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:31,660 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:31,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:31,662 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:31,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:31,663 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195871663 2023-03-30 16:54:31,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:31,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-30 16:54:31,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:31,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x0f84e5dd to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:31,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b2bb8a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:31,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,273 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:32,273 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dc10c80 to 127.0.0.1:64100 2023-03-30 16:54:32,273 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:32,273 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:32,274 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x140f3b5a to 127.0.0.1:64100 2023-03-30 16:54:32,274 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:32,274 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:32,274 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x755abd44 to 127.0.0.1:64100 2023-03-30 16:54:32,274 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:32,509 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103aa251e383b0f41ca9745e2a010e0f948 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa251e383b0f41ca9745e2a010e0f948 2023-03-30 16:54:32,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:32,522 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:32,523 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:32,529 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:32,531 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57228, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:32,540 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eeb89aba18b544dd8099113fab6b5d92 first=Optional[r3] last=Optional[r6] 2023-03-30 16:54:32,541 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eeb89aba18b544dd8099113fab6b5d92}] 2023-03-30 16:54:32,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eeb89aba18b544dd8099113fab6b5d92 for inclusion in b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:32,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-30 16:54:32,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:32,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:32,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/eeb89aba18b544dd8099113fab6b5d92 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__aq6jjjdfbqed2rcb1cevg8shlj9n7g4tsmqjkul93n7hkotbkqljrvpfjrvi1hml/family1/eeb89aba18b544dd8099113fab6b5d92 2023-03-30 16:54:32,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__aq6jjjdfbqed2rcb1cevg8shlj9n7g4tsmqjkul93n7hkotbkqljrvpfjrvi1hml/family1/eeb89aba18b544dd8099113fab6b5d92 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_ 2023-03-30 16:54:32,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__aq6jjjdfbqed2rcb1cevg8shlj9n7g4tsmqjkul93n7hkotbkqljrvpfjrvi1hml/family1/eeb89aba18b544dd8099113fab6b5d92 into b31111cc3a5f132de53c40f2d4319373/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_ - updating store file list. 2023-03-30 16:54:32,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_ into b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:32,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__aq6jjjdfbqed2rcb1cevg8shlj9n7g4tsmqjkul93n7hkotbkqljrvpfjrvi1hml/family1/eeb89aba18b544dd8099113fab6b5d92 into b31111cc3a5f132de53c40f2d4319373/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_) 2023-03-30 16:54:32,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__aq6jjjdfbqed2rcb1cevg8shlj9n7g4tsmqjkul93n7hkotbkqljrvpfjrvi1hml/family1/eeb89aba18b544dd8099113fab6b5d92 2023-03-30 16:54:32,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-30 16:54:32,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-30 16:54:32,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): b31111cc3a5f132de53c40f2d4319373/family1 is initiating minor compaction 2023-03-30 16:54:32,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@674ef81d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:32,559 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b31111cc3a5f132de53c40f2d4319373/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:32,560 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/f1cb449058cf4744bcd9de1c4ee2e916, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/bf0aeb9028ca46ec95fecc2ebabed14c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/1538f17c194845d98c983b7c04652ea8, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/48a4c504c2ff4d27a93a656fa371a12d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5a052e6eceb0497082768667aa35f9e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/16dd4fc254bd4c8cbd03825339726871, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5589ef4473eb445489965a742d87557b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/fd5d655a4aab48888e2cdd5521e95bcf, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/59784c15e648489fac954e53aff579c7, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp, totalSize=50.4 K 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting f1cb449058cf4744bcd9de1c4ee2e916, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting bf0aeb9028ca46ec95fecc2ebabed14c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 1538f17c194845d98c983b7c04652ea8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 48a4c504c2ff4d27a93a656fa371a12d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 5a052e6eceb0497082768667aa35f9e3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 16dd4fc254bd4c8cbd03825339726871, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 5589ef4473eb445489965a742d87557b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting fd5d655a4aab48888e2cdd5521e95bcf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 59784c15e648489fac954e53aff579c7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-30 16:54:32,560 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting edf05b0b5fd842d59338080993492e66_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-30 16:54:32,561 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:32,562 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:32,564 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228261c055dee154210afcbf8267fb805f8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228261c055dee154210afcbf8267fb805f8 2023-03-30 16:54:32,565 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231574dcd89a2994b68a7ade955abd4a835 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231574dcd89a2994b68a7ade955abd4a835 2023-03-30 16:54:32,566 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101641efc0efcfa43cfbae001d883f6d99b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101641efc0efcfa43cfbae001d883f6d99b 2023-03-30 16:54:32,567 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103590b4caac44441d5bf253b1f2b116915 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103590b4caac44441d5bf253b1f2b116915 2023-03-30 16:54:32,567 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-30 16:54:32,567 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:32,587 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): b31111cc3a5f132de53c40f2d4319373#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:33,023 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/ae65b862e3f84c028cbb6122723c722b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/ae65b862e3f84c028cbb6122723c722b 2023-03-30 16:54:33,028 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b31111cc3a5f132de53c40f2d4319373/family1 of b31111cc3a5f132de53c40f2d4319373 into ae65b862e3f84c028cbb6122723c722b(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:33,028 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:33,028 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1680195272559; duration=0sec 2023-03-30 16:54:33,028 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:33,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/f1cb449058cf4744bcd9de1c4ee2e916, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/bf0aeb9028ca46ec95fecc2ebabed14c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/1538f17c194845d98c983b7c04652ea8, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/48a4c504c2ff4d27a93a656fa371a12d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5a052e6eceb0497082768667aa35f9e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/16dd4fc254bd4c8cbd03825339726871, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5589ef4473eb445489965a742d87557b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/fd5d655a4aab48888e2cdd5521e95bcf, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/59784c15e648489fac954e53aff579c7, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_] to archive 2023-03-30 16:54:33,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:33,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/f1cb449058cf4744bcd9de1c4ee2e916 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/f1cb449058cf4744bcd9de1c4ee2e916 2023-03-30 16:54:33,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/bf0aeb9028ca46ec95fecc2ebabed14c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/bf0aeb9028ca46ec95fecc2ebabed14c 2023-03-30 16:54:33,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/1538f17c194845d98c983b7c04652ea8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/1538f17c194845d98c983b7c04652ea8 2023-03-30 16:54:33,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/48a4c504c2ff4d27a93a656fa371a12d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/48a4c504c2ff4d27a93a656fa371a12d 2023-03-30 16:54:33,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5a052e6eceb0497082768667aa35f9e3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5a052e6eceb0497082768667aa35f9e3 2023-03-30 16:54:33,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/16dd4fc254bd4c8cbd03825339726871 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/16dd4fc254bd4c8cbd03825339726871 2023-03-30 16:54:33,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5589ef4473eb445489965a742d87557b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5589ef4473eb445489965a742d87557b 2023-03-30 16:54:33,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/fd5d655a4aab48888e2cdd5521e95bcf to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/fd5d655a4aab48888e2cdd5521e95bcf 2023-03-30 16:54:33,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/59784c15e648489fac954e53aff579c7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/59784c15e648489fac954e53aff579c7 2023-03-30 16:54:33,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/edf05b0b5fd842d59338080993492e66_SeqId_44_ 2023-03-30 16:54:33,422 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d43634355582444d9751d6ad58643f85 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205d43634355582444d9751d6ad58643f85 2023-03-30 16:54:33,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:33,446 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/350e86fd50814fd3ac505f1eda8c7449 first=Optional[r00] last=Optional[r2] 2023-03-30 16:54:33,446 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/350e86fd50814fd3ac505f1eda8c7449}] 2023-03-30 16:54:33,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/350e86fd50814fd3ac505f1eda8c7449 for inclusion in b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:33,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-30 16:54:33,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:33,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:33,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/350e86fd50814fd3ac505f1eda8c7449 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__r12n1n3gun9atsam2jm63b1kiah7lv3bg98s3tgq7dv904jho8s7ip1jbmotfs0f/family1/350e86fd50814fd3ac505f1eda8c7449 2023-03-30 16:54:33,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__r12n1n3gun9atsam2jm63b1kiah7lv3bg98s3tgq7dv904jho8s7ip1jbmotfs0f/family1/350e86fd50814fd3ac505f1eda8c7449 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_ 2023-03-30 16:54:33,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__r12n1n3gun9atsam2jm63b1kiah7lv3bg98s3tgq7dv904jho8s7ip1jbmotfs0f/family1/350e86fd50814fd3ac505f1eda8c7449 into b31111cc3a5f132de53c40f2d4319373/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_ - updating store file list. 2023-03-30 16:54:33,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_ into b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:33,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__r12n1n3gun9atsam2jm63b1kiah7lv3bg98s3tgq7dv904jho8s7ip1jbmotfs0f/family1/350e86fd50814fd3ac505f1eda8c7449 into b31111cc3a5f132de53c40f2d4319373/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_) 2023-03-30 16:54:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__r12n1n3gun9atsam2jm63b1kiah7lv3bg98s3tgq7dv904jho8s7ip1jbmotfs0f/family1/350e86fd50814fd3ac505f1eda8c7449 2023-03-30 16:54:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-30 16:54:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-30 16:54:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): b31111cc3a5f132de53c40f2d4319373/family1 is initiating minor compaction (all files) 2023-03-30 16:54:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3d3c7081; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:33,460 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b31111cc3a5f132de53c40f2d4319373/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:33,460 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/e61363de69fa4d979e892c3949bf849f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/ae65b862e3f84c028cbb6122723c722b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp, totalSize=390.1 K 2023-03-30 16:54:33,460 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting e61363de69fa4d979e892c3949bf849f, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839396 2023-03-30 16:54:33,461 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting ae65b862e3f84c028cbb6122723c722b, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239396 2023-03-30 16:54:33,461 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839396 2023-03-30 16:54:33,462 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:33,462 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:33,464 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511301e173c26edaf491fbe8529fe0fb30640 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511301e173c26edaf491fbe8529fe0fb30640 2023-03-30 16:54:33,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d1c1b034b27746d5b07e1593fc20c76e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d1c1b034b27746d5b07e1593fc20c76e 2023-03-30 16:54:33,466 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512050d043328365b469e97baa2402a784e21 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512050d043328365b469e97baa2402a784e21 2023-03-30 16:54:33,466 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-30 16:54:33,466 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-30 16:54:33,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:33,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:33,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:33,468 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:33,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8080 sec 2023-03-30 16:54:33,476 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): b31111cc3a5f132de53c40f2d4319373#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:33,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-30 16:54:33,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:33,948 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-30 16:54:33,949 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:33,949 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-30 16:54:33,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-30 16:54:33,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE}] 2023-03-30 16:54:33,954 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE 2023-03-30 16:54:33,954 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:33,955 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195273954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195273954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195273954"}]},"ts":"1680195273954"} 2023-03-30 16:54:33,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:34,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:34,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b31111cc3a5f132de53c40f2d4319373, disabling compactions & flushes 2023-03-30 16:54:34,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:34,692 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/.tmp/family1/d6ad3bf98cba4c4386d89cef34a55535 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/d6ad3bf98cba4c4386d89cef34a55535 2023-03-30 16:54:34,697 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b31111cc3a5f132de53c40f2d4319373/family1 of b31111cc3a5f132de53c40f2d4319373 into d6ad3bf98cba4c4386d89cef34a55535(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:54:34,697 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:34,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:34,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:34,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. after waiting 0 ms 2023-03-30 16:54:34,697 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1680195273460; duration=1sec 2023-03-30 16:54:34,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:34,697 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:34,698 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/e61363de69fa4d979e892c3949bf849f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/ae65b862e3f84c028cbb6122723c722b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_] to archive 2023-03-30 16:54:34,699 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:34,701 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/e61363de69fa4d979e892c3949bf849f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/e61363de69fa4d979e892c3949bf849f 2023-03-30 16:54:34,702 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/ae65b862e3f84c028cbb6122723c722b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/ae65b862e3f84c028cbb6122723c722b 2023-03-30 16:54:34,703 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/77fa87144d7e4f52bc2267770f8e0cb7_SeqId_47_ 2023-03-30 16:54:34,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-30 16:54:34,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:34,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:34,708 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b31111cc3a5f132de53c40f2d4319373 to self. 2023-03-30 16:54:34,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:34,710 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=CLOSED 2023-03-30 16:54:34,710 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195274710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195274710"}]},"ts":"1680195274710"} 2023-03-30 16:54:34,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-30 16:54:34,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375 in 755 msec 2023-03-30 16:54:34,713 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=true 2023-03-30 16:54:34,863 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:34,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195274863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195274863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195274863"}]},"ts":"1680195274863"} 2023-03-30 16:54:34,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:35,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:35,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b31111cc3a5f132de53c40f2d4319373, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:35,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:35,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:35,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:35,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:35,021 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:35,021 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:35,021 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:35,022 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b31111cc3a5f132de53c40f2d4319373 columnFamilyName family1 2023-03-30 16:54:35,026 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/d6ad3bf98cba4c4386d89cef34a55535 2023-03-30 16:54:35,027 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(310): Store=b31111cc3a5f132de53c40f2d4319373/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:35,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:35,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:35,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:35,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b31111cc3a5f132de53c40f2d4319373; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71843420, jitterRate=0.07055038213729858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:35,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:35,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., pid=47, masterSystemTime=1680195275016 2023-03-30 16:54:35,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:35,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:35,035 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:35,035 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195275035"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195275035"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195275035"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195275035"}]},"ts":"1680195275035"} 2023-03-30 16:54:35,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-30 16:54:35,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375 in 171 msec 2023-03-30 16:54:35,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-30 16:54:35,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE in 1.0850 sec 2023-03-30 16:54:35,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-30 16:54:35,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0890 sec 2023-03-30 16:54:35,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5040 sec 2023-03-30 16:54:35,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-30 16:54:35,045 INFO [Listener at localhost/41799] compactions.TestMobCompactor(278): alter status finished 2023-03-30 16:54:35,045 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:35,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:35,047 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:35,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:35,048 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195875048 2023-03-30 16:54:35,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:35,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-30 16:54:35,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:35,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x45bef4e9 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:35,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7366ba54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:35,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,881 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280c623e5ed68345dd9b30f0c1349ff300 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280c623e5ed68345dd9b30f0c1349ff300 2023-03-30 16:54:35,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:35,895 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:35,896 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51728, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:35,902 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:35,903 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:35,911 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0db7de92256e4cb4905b291c6c27bc15 first=Optional[r05] last=Optional[r8] 2023-03-30 16:54:35,911 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=51 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0db7de92256e4cb4905b291c6c27bc15}] 2023-03-30 16:54:35,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0db7de92256e4cb4905b291c6c27bc15 for inclusion in b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:35,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-30 16:54:35,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:35,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:35,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0db7de92256e4cb4905b291c6c27bc15 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blaslerrgmfs460em1quas1djg6qjcp82d3g6a3dujjv7m6jk7q1j1tcd2kmmc4e/family1/0db7de92256e4cb4905b291c6c27bc15 2023-03-30 16:54:35,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blaslerrgmfs460em1quas1djg6qjcp82d3g6a3dujjv7m6jk7q1j1tcd2kmmc4e/family1/0db7de92256e4cb4905b291c6c27bc15 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5f6df30b74e2489b990f6e92ce80b442_SeqId_53_ 2023-03-30 16:54:35,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blaslerrgmfs460em1quas1djg6qjcp82d3g6a3dujjv7m6jk7q1j1tcd2kmmc4e/family1/0db7de92256e4cb4905b291c6c27bc15 into b31111cc3a5f132de53c40f2d4319373/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5f6df30b74e2489b990f6e92ce80b442_SeqId_53_ - updating store file list. 2023-03-30 16:54:35,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5f6df30b74e2489b990f6e92ce80b442_SeqId_53_ into b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:35,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blaslerrgmfs460em1quas1djg6qjcp82d3g6a3dujjv7m6jk7q1j1tcd2kmmc4e/family1/0db7de92256e4cb4905b291c6c27bc15 into b31111cc3a5f132de53c40f2d4319373/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5f6df30b74e2489b990f6e92ce80b442_SeqId_53_) 2023-03-30 16:54:35,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__blaslerrgmfs460em1quas1djg6qjcp82d3g6a3dujjv7m6jk7q1j1tcd2kmmc4e/family1/0db7de92256e4cb4905b291c6c27bc15 2023-03-30 16:54:35,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:35,927 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:35,929 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112026a7cd547e504401930f0429c793adca to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112026a7cd547e504401930f0429c793adca 2023-03-30 16:54:35,929 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128867ac24a359f45ed998e6883b2035735 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128867ac24a359f45ed998e6883b2035735 2023-03-30 16:54:35,929 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-30 16:54:35,930 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-30 16:54:35,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:35,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:35,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:35,931 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:35,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 885 msec 2023-03-30 16:54:35,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-30 16:54:35,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:36,372 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-30 16:54:36,385 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-30 16:54:36,386 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-30 16:54:36,386 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-30 16:54:36,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-30 16:54:36,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE}] 2023-03-30 16:54:36,393 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE 2023-03-30 16:54:36,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:36,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195276393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195276393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195276393"}]},"ts":"1680195276393"} 2023-03-30 16:54:36,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:36,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b31111cc3a5f132de53c40f2d4319373, disabling compactions & flushes 2023-03-30 16:54:36,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:36,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:36,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. after waiting 0 ms 2023-03-30 16:54:36,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:36,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-30 16:54:36,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:36,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:36,554 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b31111cc3a5f132de53c40f2d4319373 to self. 2023-03-30 16:54:36,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,556 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=CLOSED 2023-03-30 16:54:36,556 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195276556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195276556"}]},"ts":"1680195276556"} 2023-03-30 16:54:36,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-30 16:54:36,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375 in 162 msec 2023-03-30 16:54:36,559 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=true 2023-03-30 16:54:36,709 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:36,709 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195276709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195276709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195276709"}]},"ts":"1680195276709"} 2023-03-30 16:54:36,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:36,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:36,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b31111cc3a5f132de53c40f2d4319373, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:36,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:36,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,867 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,868 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:36,868 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1 2023-03-30 16:54:36,868 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b31111cc3a5f132de53c40f2d4319373 columnFamilyName family1 2023-03-30 16:54:36,873 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/5f6df30b74e2489b990f6e92ce80b442_SeqId_53_ 2023-03-30 16:54:36,876 DEBUG [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/family1/d6ad3bf98cba4c4386d89cef34a55535 2023-03-30 16:54:36,876 INFO [StoreOpener-b31111cc3a5f132de53c40f2d4319373-1] regionserver.HStore(310): Store=b31111cc3a5f132de53c40f2d4319373/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:36,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:54:36,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b31111cc3a5f132de53c40f2d4319373; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62866248, jitterRate=-0.06321990489959717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:36,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:54:36,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373., pid=53, masterSystemTime=1680195276863 2023-03-30 16:54:36,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:36,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:54:36,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b31111cc3a5f132de53c40f2d4319373, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:36,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680195276884"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195276884"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195276884"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195276884"}]},"ts":"1680195276884"} 2023-03-30 16:54:36,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-30 16:54:36,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure b31111cc3a5f132de53c40f2d4319373, server=jenkins-hbase4.apache.org,39029,1680195214375 in 175 msec 2023-03-30 16:54:36,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-30 16:54:36,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b31111cc3a5f132de53c40f2d4319373, REOPEN/MOVE in 496 msec 2023-03-30 16:54:36,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-30 16:54:36,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 501 msec 2023-03-30 16:54:36,894 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 918 msec 2023-03-30 16:54:36,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-30 16:54:36,897 INFO [Listener at localhost/41799] compactions.TestMobCompactor(278): alter status finished 2023-03-30 16:54:36,898 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-30 16:54:36,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:36,900 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:36,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:36,901 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195876901 2023-03-30 16:54:36,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:36,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-30 16:54:36,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:36,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x6dae3683 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:36,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b5c8578, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-30 16:54:36,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-30 16:54:36,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:36,909 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-30 16:54:36,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-03-30 16:54:36,958 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249 (was 256), OpenFileDescriptor=622 (was 620) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 422), ProcessCount=169 (was 169), AvailableMemoryMB=4635 (was 4734) 2023-03-30 16:54:36,969 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=371, ProcessCount=169, AvailableMemoryMB=4634 2023-03-30 16:54:36,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-30 16:54:36,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:36,972 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:54:36,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-30 16:54:36,973 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:54:36,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-30 16:54:36,974 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:36,975 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe empty. 2023-03-30 16:54:36,975 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:36,975 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-30 16:54:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-30 16:54:37,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-30 16:54:37,382 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:37,384 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => f0fc9e1c2a385007d6f3a1a6db901efe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:37,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-30 16:54:37,789 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:37,790 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing f0fc9e1c2a385007d6f3a1a6db901efe, disabling compactions & flushes 2023-03-30 16:54:37,790 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:37,790 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:37,790 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. after waiting 0 ms 2023-03-30 16:54:37,790 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:37,790 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:37,790 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:37,792 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:54:37,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195277793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195277793"}]},"ts":"1680195277793"} 2023-03-30 16:54:37,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:54:37,796 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:54:37,796 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195277796"}]},"ts":"1680195277796"} 2023-03-30 16:54:37,797 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-30 16:54:37,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, ASSIGN}] 2023-03-30 16:54:37,802 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, ASSIGN 2023-03-30 16:54:37,803 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:37,954 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:37,955 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195277954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195277954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195277954"}]},"ts":"1680195277954"} 2023-03-30 16:54:37,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:38,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-30 16:54:38,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:38,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0fc9e1c2a385007d6f3a1a6db901efe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:38,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:38,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:38,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:38,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:38,114 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:38,117 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:38,117 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:38,117 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0fc9e1c2a385007d6f3a1a6db901efe columnFamilyName family1 2023-03-30 16:54:38,119 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(310): Store=f0fc9e1c2a385007d6f3a1a6db901efe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:38,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:38,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:38,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:38,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:38,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f0fc9e1c2a385007d6f3a1a6db901efe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59860929, jitterRate=-0.10800264775753021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:38,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:38,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., pid=57, masterSystemTime=1680195278108 2023-03-30 16:54:38,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:38,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:38,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:38,131 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195278130"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195278130"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195278130"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195278130"}]},"ts":"1680195278130"} 2023-03-30 16:54:38,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-30 16:54:38,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375 in 176 msec 2023-03-30 16:54:38,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-30 16:54:38,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, ASSIGN in 332 msec 2023-03-30 16:54:38,135 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:54:38,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195278135"}]},"ts":"1680195278135"} 2023-03-30 16:54:38,137 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-30 16:54:38,139 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:54:38,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1690 sec 2023-03-30 16:54:39,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-30 16:54:39,078 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-30 16:54:39,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:39,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,125 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:39,125 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:39,125 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:39,125 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:39,125 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,125 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,126 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:39,126 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:39,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:39,127 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,127 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:39,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,128 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,128 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:39,128 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:39,128 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:39,136 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:39,136 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:39,136 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:39,136 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:39,137 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-30 16:54:39,182 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307a525279a4e14015bf3c5c0866efd768 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511307a525279a4e14015bf3c5c0866efd768 2023-03-30 16:54:39,188 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/12415887b32a4924b97e6f9228f95087 2023-03-30 16:54:39,203 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/12415887b32a4924b97e6f9228f95087 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/12415887b32a4924b97e6f9228f95087 2023-03-30 16:54:39,209 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/12415887b32a4924b97e6f9228f95087, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-30 16:54:39,210 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 73ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:39,210 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:39,210 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:39,210 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:39,213 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,213 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:39,214 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,214 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:39,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:39,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c1a1389[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:39,216 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:39,216 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,217 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,217 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:39,217 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:39,217 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:39,218 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,218 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:39,220 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:39,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:39,223 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:39,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:39,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:39,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,223 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:39,225 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,225 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:39,225 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:39,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,226 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,228 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:39,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:39,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:39,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:39,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:39,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:39,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,234 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:39,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,235 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,235 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,235 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:39,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:39,235 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:39,335 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:39,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:39,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:39,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:39,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,345 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:39,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:39,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:39,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:39,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,349 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:39,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:39,349 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,350 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,350 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:39,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:39,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,356 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:39,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:39,360 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:39,360 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:39,360 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:39,360 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:39,360 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-30 16:54:39,392 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112892670f095c16407aad8ed387582b510e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112892670f095c16407aad8ed387582b510e 2023-03-30 16:54:39,804 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/a40bf74b95a74e41948c32e75af28668 2023-03-30 16:54:39,812 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/a40bf74b95a74e41948c32e75af28668 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/a40bf74b95a74e41948c32e75af28668 2023-03-30 16:54:39,822 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/a40bf74b95a74e41948c32e75af28668, entries=1, sequenceid=9, filesize=5.0 K 2023-03-30 16:54:39,823 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 463ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:39,823 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:39,823 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:39,823 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:39,823 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:39,823 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,823 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:39,823 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:39,825 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,825 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:39,825 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,825 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:39,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4785524f[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:39,828 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:39,828 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,829 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,830 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:39,830 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:39,830 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:39,832 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,832 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:39,834 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:39,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:39,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:39,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:39,838 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:39,838 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:39,838 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:39,838 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,838 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:39,842 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,842 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,842 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:39,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:39,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:39,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:39,843 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,844 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:39,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:39,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:39,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,848 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:39,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:39,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:39,848 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:39,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:39,849 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:39,849 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:39,949 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:39,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:39,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:39,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:39,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,988 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:39,988 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:39,988 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:39,988 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:39,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,990 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,990 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:39,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:39,991 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:39,991 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,991 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,992 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:39,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:39,992 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:39,992 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:39,992 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:39,996 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:39,996 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:39,996 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:39,996 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:39,996 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:40,026 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019238ce1d011d42ce87c9d019b84f46bc to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512019238ce1d011d42ce87c9d019b84f46bc 2023-03-30 16:54:40,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:54:40,435 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/44e0245659714510bdea91f86d53a11a 2023-03-30 16:54:40,440 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/44e0245659714510bdea91f86d53a11a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/44e0245659714510bdea91f86d53a11a 2023-03-30 16:54:40,451 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/44e0245659714510bdea91f86d53a11a, entries=1, sequenceid=13, filesize=5.0 K 2023-03-30 16:54:40,452 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 456ms, sequenceid=13, compaction requested=true 2023-03-30 16:54:40,452 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:40,452 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:40,452 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:40,452 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:40,452 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,452 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:40,452 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:40,455 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:40,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,455 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:40,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:40,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:40,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:40,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:40,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@137d59f9[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:40,457 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:40,457 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,459 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,459 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:40,459 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:40,459 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:40,459 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,459 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:40,460 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,460 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:40,460 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,460 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:40,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:40,464 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:40,464 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:40,464 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:40,464 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,464 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:40,466 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:40,466 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,466 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:40,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:40,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,468 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,469 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:40,473 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:40,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:40,473 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:40,474 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:40,574 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:40,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:40,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:40,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:40,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,581 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:40,581 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:40,581 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:40,581 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:40,582 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,582 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,583 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:40,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:40,583 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,584 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:40,584 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:40,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,585 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:40,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:40,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:40,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:40,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:40,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:40,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:40,585 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:40,585 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:40,585 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:41,001 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120555d325cb8b0a455a88a5f2fc37bb30bb to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120555d325cb8b0a455a88a5f2fc37bb30bb 2023-03-30 16:54:41,008 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/d6df403944a44a0e88a4f5712546572b 2023-03-30 16:54:41,014 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/d6df403944a44a0e88a4f5712546572b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/d6df403944a44a0e88a4f5712546572b 2023-03-30 16:54:41,019 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/d6df403944a44a0e88a4f5712546572b, entries=1, sequenceid=17, filesize=5.0 K 2023-03-30 16:54:41,020 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 435ms, sequenceid=17, compaction requested=true 2023-03-30 16:54:41,020 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:41,020 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,020 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:41,020 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:41,020 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,020 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:41,020 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:41,022 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,022 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:41,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c5ea5e9[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:41,024 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:41,024 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,028 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:41,029 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,029 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:41,030 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,030 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:41,030 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,030 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:41,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:41,034 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:41,034 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:41,034 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:41,034 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,034 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:41,036 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,036 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,036 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,037 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,038 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,041 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:41,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:41,041 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:41,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,142 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:41,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:41,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:41,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:41,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,151 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,151 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,151 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:41,151 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:41,152 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,152 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,154 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,154 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,154 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,154 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,155 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:41,156 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,156 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:41,156 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:41,185 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f8735d16b93f439ba2bec28e1d3508e0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228f8735d16b93f439ba2bec28e1d3508e0 2023-03-30 16:54:41,206 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/258e5e14ff2d4e47aa84494dad1dfbf4 2023-03-30 16:54:41,211 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/258e5e14ff2d4e47aa84494dad1dfbf4 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/258e5e14ff2d4e47aa84494dad1dfbf4 2023-03-30 16:54:41,218 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/258e5e14ff2d4e47aa84494dad1dfbf4, entries=1, sequenceid=21, filesize=5.0 K 2023-03-30 16:54:41,218 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 62ms, sequenceid=21, compaction requested=true 2023-03-30 16:54:41,219 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:41,219 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,219 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:41,219 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:41,219 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,219 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:41,219 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:41,220 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@508479b0[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:41,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:41,223 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,225 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,225 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:41,225 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:41,225 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:41,225 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,225 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:41,226 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:41,229 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:41,229 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:41,229 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:41,229 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,230 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:41,232 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,232 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,232 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,238 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,239 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,242 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:41,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,243 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:41,243 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:41,343 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:41,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:41,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:41,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:41,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,349 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,349 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,349 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:41,349 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:41,349 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,349 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,351 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,351 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,351 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,351 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,352 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,353 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:41,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,353 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:41,353 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,353 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:41,353 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:41,353 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:41,353 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,354 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:41,354 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:41,391 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316ae29730fe5043378afd4d89cf713b99 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316ae29730fe5043378afd4d89cf713b99 2023-03-30 16:54:41,416 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/5c36bac4ad99420e8aaa907bc3de586b 2023-03-30 16:54:41,422 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/5c36bac4ad99420e8aaa907bc3de586b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/5c36bac4ad99420e8aaa907bc3de586b 2023-03-30 16:54:41,428 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/5c36bac4ad99420e8aaa907bc3de586b, entries=1, sequenceid=25, filesize=5.0 K 2023-03-30 16:54:41,429 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 75ms, sequenceid=25, compaction requested=true 2023-03-30 16:54:41,429 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:41,429 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,429 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:41,429 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:41,429 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,429 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:41,429 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:41,431 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:41,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dfe4ec5[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:41,434 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:41,434 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,436 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:41,437 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,437 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:41,439 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:41,439 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,439 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,439 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:41,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:41,442 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:41,442 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:41,442 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:41,442 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,442 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:41,445 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,445 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,446 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,447 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,449 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,460 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,460 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,463 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:41,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,464 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:41,464 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:41,564 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:41,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:41,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:41,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:41,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,572 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,572 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,572 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:41,572 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:41,573 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,573 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,581 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,581 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,582 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,582 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:41,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:41,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,583 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,583 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:41,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:41,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:41,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:41,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:41,584 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,584 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:41,584 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:41,604 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010962ec8c5e53496cb172765fe12f7a02 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010962ec8c5e53496cb172765fe12f7a02 2023-03-30 16:54:41,617 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/ab7e82fdf17b4554955112abdc36cca9 2023-03-30 16:54:41,629 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/ab7e82fdf17b4554955112abdc36cca9 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/ab7e82fdf17b4554955112abdc36cca9 2023-03-30 16:54:41,637 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/ab7e82fdf17b4554955112abdc36cca9, entries=1, sequenceid=29, filesize=5.0 K 2023-03-30 16:54:41,638 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 54ms, sequenceid=29, compaction requested=true 2023-03-30 16:54:41,638 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:41,638 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:41,641 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,641 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,641 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,641 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44356a12[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:41,644 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:41,644 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,645 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,646 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:41,646 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:41,646 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:41,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,646 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:41,649 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:41,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:41,655 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:41,655 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:41,655 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:41,655 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,655 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:41,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,664 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,666 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,668 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,668 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:41,669 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:41,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,669 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:41,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,769 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:41,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:41,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:41,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:41,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,779 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,779 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,779 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:41,779 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:41,780 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,780 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,781 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,781 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,782 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,782 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:41,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,783 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,792 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:41,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,792 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:41,792 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,792 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:41,803 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,803 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:41,803 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:41,839 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010359bb6ea74e764c22a526db38f8cf114b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010359bb6ea74e764c22a526db38f8cf114b 2023-03-30 16:54:41,850 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/27c784c7adb1429f8adb928a2d9d6ee5 2023-03-30 16:54:41,858 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/27c784c7adb1429f8adb928a2d9d6ee5 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/27c784c7adb1429f8adb928a2d9d6ee5 2023-03-30 16:54:41,865 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/27c784c7adb1429f8adb928a2d9d6ee5, entries=1, sequenceid=33, filesize=5.0 K 2023-03-30 16:54:41,866 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 63ms, sequenceid=33, compaction requested=true 2023-03-30 16:54:41,866 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:41,866 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:41,867 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,867 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:41,867 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:41,869 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,869 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,870 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,870 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:41,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dbdfe90[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:41,873 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:41,873 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,875 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:41,875 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,875 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,877 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:41,879 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:41,879 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:41,879 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:41,879 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,879 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:41,881 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,881 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,881 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:41,882 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:41,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,884 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,888 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,888 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,888 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,888 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:41,888 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:41,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-30 16:54:41,888 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,889 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:41,888 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,889 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,889 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,889 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:41,889 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:41,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:41,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:41,989 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:41,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:41,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:41,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:41,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,996 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:41,996 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:41,996 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:41,996 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:41,997 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,997 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:41,998 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,999 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:41,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:41,999 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:41,999 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,000 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,000 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:42,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:42,001 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:42,001 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:42,001 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:42,035 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ce60e979ee43479689c81326c8974798 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907ce60e979ee43479689c81326c8974798 2023-03-30 16:54:42,046 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/0ed4124913bf44979e4a7ba862e29e64 2023-03-30 16:54:42,058 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/0ed4124913bf44979e4a7ba862e29e64 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/0ed4124913bf44979e4a7ba862e29e64 2023-03-30 16:54:42,064 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/0ed4124913bf44979e4a7ba862e29e64, entries=1, sequenceid=37, filesize=5.0 K 2023-03-30 16:54:42,065 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 64ms, sequenceid=37, compaction requested=true 2023-03-30 16:54:42,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:42,065 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:42,065 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:42,065 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:42,065 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,066 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:42,066 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:42,067 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,067 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:42,068 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,068 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:42,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:42,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e87596e[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:42,069 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:42,069 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,072 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,072 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:42,072 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:42,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:42,072 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:42,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:42,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:42,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:42,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:42,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:42,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:42,084 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:42,084 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:42,084 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:42,084 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,084 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:42,087 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,087 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:42,087 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:42,088 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,089 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:42,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:42,093 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:42,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:42,093 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:42,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:42,194 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:42,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:42,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:42,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:42,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,200 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:42,200 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:42,200 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-30 16:54:42,200 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-30 16:54:42,201 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,201 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,202 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:42,202 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:42,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:42,203 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,203 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:42,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:42,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-30 16:54:42,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,204 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-30 16:54:42,204 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:42,204 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-30 16:54:42,204 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:54:42,204 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:42,204 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:42,204 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. started... 2023-03-30 16:54:42,204 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0fc9e1c2a385007d6f3a1a6db901efe 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:54:42,618 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c8dde617e15e4f47ae14d36d85628968 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c8dde617e15e4f47ae14d36d85628968 2023-03-30 16:54:42,625 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/2590049e84e84c4c856fec3798699f75 2023-03-30 16:54:42,630 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/2590049e84e84c4c856fec3798699f75 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/2590049e84e84c4c856fec3798699f75 2023-03-30 16:54:42,639 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/2590049e84e84c4c856fec3798699f75, entries=1, sequenceid=41, filesize=5.0 K 2023-03-30 16:54:42,640 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0fc9e1c2a385007d6f3a1a6db901efe in 436ms, sequenceid=41, compaction requested=true 2023-03-30 16:54:42,640 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:42,640 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-30 16:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-30 16:54:42,642 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,642 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:42,643 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,643 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:42,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-30 16:54:42,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c0ae1d[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:42,645 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-30 16:54:42,645 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,647 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,647 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-30 16:54:42,647 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-30 16:54:42,647 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,647 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:42,647 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:42,649 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,649 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-30 16:54:42,649 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:42,649 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-30 16:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:42,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-30 16:54:42,652 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-30 16:54:42,652 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:42,652 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:42,652 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,652 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:42,655 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,655 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:42,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:42,655 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,657 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:42,658 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,661 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:42,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:42,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-30 16:54:42,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:42,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:42,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:42,661 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,662 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:42,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:42,662 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:42,662 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:42,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:42,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:42,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-30 16:54:42,762 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:42,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:42,765 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:42,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:42,769 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:42,770 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195882770 2023-03-30 16:54:42,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:42,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:42,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-30 16:54:42,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:42,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x4cf09208 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:42,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b9a6831, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:42,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:42,808 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-30 16:54:43,664 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035f01cdafc6684c9a8018255e727b96e7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035f01cdafc6684c9a8018255e727b96e7 2023-03-30 16:54:43,665 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:43,678 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:43,679 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:43,688 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:43,689 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:43,699 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2f2ea4a038649cea2231dae6d744cc7 first=Optional[r3] last=Optional[r6] 2023-03-30 16:54:43,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2f2ea4a038649cea2231dae6d744cc7}] 2023-03-30 16:54:43,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2f2ea4a038649cea2231dae6d744cc7 for inclusion in f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:43,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-30 16:54:43,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:43,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:43,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2f2ea4a038649cea2231dae6d744cc7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vnrab5eecvbvqe48lj1evc145ddu0n56hf3bc3puck1vb5bqhe4croagfmend0rd/family1/a2f2ea4a038649cea2231dae6d744cc7 2023-03-30 16:54:43,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vnrab5eecvbvqe48lj1evc145ddu0n56hf3bc3puck1vb5bqhe4croagfmend0rd/family1/a2f2ea4a038649cea2231dae6d744cc7 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_ 2023-03-30 16:54:43,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vnrab5eecvbvqe48lj1evc145ddu0n56hf3bc3puck1vb5bqhe4croagfmend0rd/family1/a2f2ea4a038649cea2231dae6d744cc7 into f0fc9e1c2a385007d6f3a1a6db901efe/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_ - updating store file list. 2023-03-30 16:54:43,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_ into f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:43,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vnrab5eecvbvqe48lj1evc145ddu0n56hf3bc3puck1vb5bqhe4croagfmend0rd/family1/a2f2ea4a038649cea2231dae6d744cc7 into f0fc9e1c2a385007d6f3a1a6db901efe/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_) 2023-03-30 16:54:43,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vnrab5eecvbvqe48lj1evc145ddu0n56hf3bc3puck1vb5bqhe4croagfmend0rd/family1/a2f2ea4a038649cea2231dae6d744cc7 2023-03-30 16:54:43,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-30 16:54:43,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-30 16:54:43,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): f0fc9e1c2a385007d6f3a1a6db901efe/family1 is initiating minor compaction 2023-03-30 16:54:43,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@275e86f9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:43,729 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f0fc9e1c2a385007d6f3a1a6db901efe/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:43,729 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/a40bf74b95a74e41948c32e75af28668, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/44e0245659714510bdea91f86d53a11a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/d6df403944a44a0e88a4f5712546572b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/258e5e14ff2d4e47aa84494dad1dfbf4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/5c36bac4ad99420e8aaa907bc3de586b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/ab7e82fdf17b4554955112abdc36cca9, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/27c784c7adb1429f8adb928a2d9d6ee5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/0ed4124913bf44979e4a7ba862e29e64, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/2590049e84e84c4c856fec3798699f75, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp, totalSize=50.3 K 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting a40bf74b95a74e41948c32e75af28668, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 44e0245659714510bdea91f86d53a11a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting d6df403944a44a0e88a4f5712546572b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 258e5e14ff2d4e47aa84494dad1dfbf4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 5c36bac4ad99420e8aaa907bc3de586b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting ab7e82fdf17b4554955112abdc36cca9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 27c784c7adb1429f8adb928a2d9d6ee5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 0ed4124913bf44979e4a7ba862e29e64, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 2590049e84e84c4c856fec3798699f75, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-30 16:54:43,730 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 8c6fa96416814b19a78e4a0911c10069_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-30 16:54:43,732 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:43,733 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:43,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228f8735d16b93f439ba2bec28e1d3508e0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228f8735d16b93f439ba2bec28e1d3508e0 2023-03-30 16:54:43,737 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316ae29730fe5043378afd4d89cf713b99 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316ae29730fe5043378afd4d89cf713b99 2023-03-30 16:54:43,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010962ec8c5e53496cb172765fe12f7a02 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010962ec8c5e53496cb172765fe12f7a02 2023-03-30 16:54:43,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010359bb6ea74e764c22a526db38f8cf114b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010359bb6ea74e764c22a526db38f8cf114b 2023-03-30 16:54:43,739 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-30 16:54:43,739 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,800 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): f0fc9e1c2a385007d6f3a1a6db901efe#family1#compaction#73 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:43,885 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120554bc5b548dc04cbbb9eb93bbefa77c5e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120554bc5b548dc04cbbb9eb93bbefa77c5e 2023-03-30 16:54:43,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:43,915 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3725fc92b71f440ca069ba9f5eea7f54 first=Optional[r00] last=Optional[r2] 2023-03-30 16:54:43,915 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3725fc92b71f440ca069ba9f5eea7f54}] 2023-03-30 16:54:43,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3725fc92b71f440ca069ba9f5eea7f54 for inclusion in f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-30 16:54:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:43,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3725fc92b71f440ca069ba9f5eea7f54 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nnjjr5fcdkhqr21mkb6knb6ietg7oiicmc892iu91t0jh3oteum25ens1rjoaj41/family1/3725fc92b71f440ca069ba9f5eea7f54 2023-03-30 16:54:43,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nnjjr5fcdkhqr21mkb6knb6ietg7oiicmc892iu91t0jh3oteum25ens1rjoaj41/family1/3725fc92b71f440ca069ba9f5eea7f54 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_ 2023-03-30 16:54:43,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nnjjr5fcdkhqr21mkb6knb6ietg7oiicmc892iu91t0jh3oteum25ens1rjoaj41/family1/3725fc92b71f440ca069ba9f5eea7f54 into f0fc9e1c2a385007d6f3a1a6db901efe/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_ - updating store file list. 2023-03-30 16:54:43,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_ into f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:43,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nnjjr5fcdkhqr21mkb6knb6ietg7oiicmc892iu91t0jh3oteum25ens1rjoaj41/family1/3725fc92b71f440ca069ba9f5eea7f54 into f0fc9e1c2a385007d6f3a1a6db901efe/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_) 2023-03-30 16:54:43,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nnjjr5fcdkhqr21mkb6knb6ietg7oiicmc892iu91t0jh3oteum25ens1rjoaj41/family1/3725fc92b71f440ca069ba9f5eea7f54 2023-03-30 16:54:43,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:43,934 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:43,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511307a525279a4e14015bf3c5c0866efd768 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511307a525279a4e14015bf3c5c0866efd768 2023-03-30 16:54:43,938 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512019238ce1d011d42ce87c9d019b84f46bc to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512019238ce1d011d42ce87c9d019b84f46bc 2023-03-30 16:54:43,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120555d325cb8b0a455a88a5f2fc37bb30bb to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120555d325cb8b0a455a88a5f2fc37bb30bb 2023-03-30 16:54:43,939 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-30 16:54:43,939 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-30 16:54:43,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:43,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:43,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:43,941 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:43,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.1760 sec 2023-03-30 16:54:44,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-30 16:54:44,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:44,063 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-30 16:54:44,064 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:44,064 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-30 16:54:44,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-30 16:54:44,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE}] 2023-03-30 16:54:44,075 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE 2023-03-30 16:54:44,076 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:44,076 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195284075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195284075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195284075"}]},"ts":"1680195284075"} 2023-03-30 16:54:44,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:44,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f0fc9e1c2a385007d6f3a1a6db901efe, disabling compactions & flushes 2023-03-30 16:54:44,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,254 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/979b395e72de4b599f0af1b15e7b8e67 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/979b395e72de4b599f0af1b15e7b8e67 2023-03-30 16:54:44,259 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f0fc9e1c2a385007d6f3a1a6db901efe/family1 of f0fc9e1c2a385007d6f3a1a6db901efe into 979b395e72de4b599f0af1b15e7b8e67(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:44,259 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:44,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,259 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1680195283729; duration=0sec 2023-03-30 16:54:44,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. after waiting 0 ms 2023-03-30 16:54:44,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,259 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:44,273 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/a40bf74b95a74e41948c32e75af28668, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/44e0245659714510bdea91f86d53a11a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/d6df403944a44a0e88a4f5712546572b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/258e5e14ff2d4e47aa84494dad1dfbf4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/5c36bac4ad99420e8aaa907bc3de586b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/ab7e82fdf17b4554955112abdc36cca9, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/27c784c7adb1429f8adb928a2d9d6ee5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/0ed4124913bf44979e4a7ba862e29e64, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/2590049e84e84c4c856fec3798699f75, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_] to archive 2023-03-30 16:54:44,274 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:44,276 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/a40bf74b95a74e41948c32e75af28668 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/a40bf74b95a74e41948c32e75af28668 2023-03-30 16:54:44,278 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/44e0245659714510bdea91f86d53a11a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/44e0245659714510bdea91f86d53a11a 2023-03-30 16:54:44,279 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/d6df403944a44a0e88a4f5712546572b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/d6df403944a44a0e88a4f5712546572b 2023-03-30 16:54:44,280 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/258e5e14ff2d4e47aa84494dad1dfbf4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/258e5e14ff2d4e47aa84494dad1dfbf4 2023-03-30 16:54:44,281 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/5c36bac4ad99420e8aaa907bc3de586b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/5c36bac4ad99420e8aaa907bc3de586b 2023-03-30 16:54:44,282 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/ab7e82fdf17b4554955112abdc36cca9 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/ab7e82fdf17b4554955112abdc36cca9 2023-03-30 16:54:44,283 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/27c784c7adb1429f8adb928a2d9d6ee5 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/27c784c7adb1429f8adb928a2d9d6ee5 2023-03-30 16:54:44,285 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/0ed4124913bf44979e4a7ba862e29e64 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/0ed4124913bf44979e4a7ba862e29e64 2023-03-30 16:54:44,286 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/2590049e84e84c4c856fec3798699f75 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/2590049e84e84c4c856fec3798699f75 2023-03-30 16:54:44,287 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/8c6fa96416814b19a78e4a0911c10069_SeqId_44_ 2023-03-30 16:54:44,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-30 16:54:44,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:44,295 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: f0fc9e1c2a385007d6f3a1a6db901efe to self. 2023-03-30 16:54:44,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,297 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=CLOSED 2023-03-30 16:54:44,297 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195284297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195284297"}]},"ts":"1680195284297"} 2023-03-30 16:54:44,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-30 16:54:44,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375 in 220 msec 2023-03-30 16:54:44,300 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=true 2023-03-30 16:54:44,450 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:44,451 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195284450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195284450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195284450"}]},"ts":"1680195284450"} 2023-03-30 16:54:44,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:44,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0fc9e1c2a385007d6f3a1a6db901efe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:44,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:44,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,609 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,610 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:44,610 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:44,610 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0fc9e1c2a385007d6f3a1a6db901efe columnFamilyName family1 2023-03-30 16:54:44,617 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/12415887b32a4924b97e6f9228f95087 2023-03-30 16:54:44,621 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_ 2023-03-30 16:54:44,625 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/979b395e72de4b599f0af1b15e7b8e67 2023-03-30 16:54:44,625 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(310): Store=f0fc9e1c2a385007d6f3a1a6db901efe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:44,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:44,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f0fc9e1c2a385007d6f3a1a6db901efe; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70813609, jitterRate=0.055205002427101135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:44,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:44,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., pid=63, masterSystemTime=1680195284604 2023-03-30 16:54:44,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:44,632 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-30 16:54:44,633 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-30 16:54:44,633 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1912): f0fc9e1c2a385007d6f3a1a6db901efe/family1 is initiating minor compaction (all files) 2023-03-30 16:54:44,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,633 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f0fc9e1c2a385007d6f3a1a6db901efe/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:44,633 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/12415887b32a4924b97e6f9228f95087, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/979b395e72de4b599f0af1b15e7b8e67, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp, totalSize=388.1 K 2023-03-30 16:54:44,634 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:44,634 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 12415887b32a4924b97e6f9228f95087, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839396 2023-03-30 16:54:44,634 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195284633"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195284633"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195284633"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195284633"}]},"ts":"1680195284633"} 2023-03-30 16:54:44,634 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 979b395e72de4b599f0af1b15e7b8e67, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239396 2023-03-30 16:54:44,635 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 352c318d46924ae3a9639220b79c3a69_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878839396 2023-03-30 16:54:44,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-30 16:54:44,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375 in 183 msec 2023-03-30 16:54:44,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-30 16:54:44,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE in 563 msec 2023-03-30 16:54:44,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-30 16:54:44,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 573 msec 2023-03-30 16:54:44,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 597 msec 2023-03-30 16:54:44,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-30 16:54:44,646 INFO [Listener at localhost/41799] compactions.TestMobCompactor(278): alter status finished 2023-03-30 16:54:44,647 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:44,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:44,649 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:44,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:44,650 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195884650 2023-03-30 16:54:44,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:44,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-30 16:54:44,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:44,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x0e23e41a to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:44,657 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): f0fc9e1c2a385007d6f3a1a6db901efe#family1#compaction#74 average throughput is 14.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:44,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@85d57f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:44,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,721 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285ebfe512f32147b88b024cb26d04d19a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285ebfe512f32147b88b024cb26d04d19a 2023-03-30 16:54:44,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:44,738 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:44,739 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:44,746 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:44,748 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49964, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:44,760 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be3394b948dc40e78ca9c87ea3dbefde first=Optional[r05] last=Optional[r8] 2023-03-30 16:54:44,761 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=50 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be3394b948dc40e78ca9c87ea3dbefde}] 2023-03-30 16:54:44,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be3394b948dc40e78ca9c87ea3dbefde for inclusion in f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:44,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-30 16:54:44,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be3394b948dc40e78ca9c87ea3dbefde to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d40f1rkvejrush3fqp3lc5m2k1bdjb57bo3hag8uia00454fkaj56mbohg08ac1m/family1/be3394b948dc40e78ca9c87ea3dbefde 2023-03-30 16:54:44,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d40f1rkvejrush3fqp3lc5m2k1bdjb57bo3hag8uia00454fkaj56mbohg08ac1m/family1/be3394b948dc40e78ca9c87ea3dbefde as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/41b7958bda53430cbef21f6bf283ed61_SeqId_52_ 2023-03-30 16:54:44,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d40f1rkvejrush3fqp3lc5m2k1bdjb57bo3hag8uia00454fkaj56mbohg08ac1m/family1/be3394b948dc40e78ca9c87ea3dbefde into f0fc9e1c2a385007d6f3a1a6db901efe/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/41b7958bda53430cbef21f6bf283ed61_SeqId_52_ - updating store file list. 2023-03-30 16:54:44,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/41b7958bda53430cbef21f6bf283ed61_SeqId_52_ into f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:44,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d40f1rkvejrush3fqp3lc5m2k1bdjb57bo3hag8uia00454fkaj56mbohg08ac1m/family1/be3394b948dc40e78ca9c87ea3dbefde into f0fc9e1c2a385007d6f3a1a6db901efe/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/41b7958bda53430cbef21f6bf283ed61_SeqId_52_) 2023-03-30 16:54:44,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d40f1rkvejrush3fqp3lc5m2k1bdjb57bo3hag8uia00454fkaj56mbohg08ac1m/family1/be3394b948dc40e78ca9c87ea3dbefde 2023-03-30 16:54:44,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:44,781 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:44,782 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c8dde617e15e4f47ae14d36d85628968 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c8dde617e15e4f47ae14d36d85628968 2023-03-30 16:54:44,783 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112892670f095c16407aad8ed387582b510e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112892670f095c16407aad8ed387582b510e 2023-03-30 16:54:44,783 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-30 16:54:44,783 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-30 16:54:44,784 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,784 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,784 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:44,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:44,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:44,785 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:44,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 139 msec 2023-03-30 16:54:44,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-30 16:54:44,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:44,899 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-30 16:54:44,900 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-30 16:54:44,900 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-30 16:54:44,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-30 16:54:44,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE}] 2023-03-30 16:54:44,907 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE 2023-03-30 16:54:44,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:44,908 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195284907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195284907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195284907"}]},"ts":"1680195284907"} 2023-03-30 16:54:44,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:45,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f0fc9e1c2a385007d6f3a1a6db901efe, disabling compactions & flushes 2023-03-30 16:54:45,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,115 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/.tmp/family1/7f7fee2a02ac4e278fd600ab16e6e341 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/7f7fee2a02ac4e278fd600ab16e6e341 2023-03-30 16:54:45,127 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f0fc9e1c2a385007d6f3a1a6db901efe/family1 of f0fc9e1c2a385007d6f3a1a6db901efe into 7f7fee2a02ac4e278fd600ab16e6e341(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:45,127 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:45,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,127 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., storeName=f0fc9e1c2a385007d6f3a1a6db901efe/family1, priority=13, startTime=1680195284631; duration=0sec 2023-03-30 16:54:45,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. after waiting 0 ms 2023-03-30 16:54:45,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,127 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:45,139 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/12415887b32a4924b97e6f9228f95087, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/979b395e72de4b599f0af1b15e7b8e67, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_] to archive 2023-03-30 16:54:45,140 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:45,143 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/12415887b32a4924b97e6f9228f95087 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/12415887b32a4924b97e6f9228f95087 2023-03-30 16:54:45,144 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/979b395e72de4b599f0af1b15e7b8e67 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/979b395e72de4b599f0af1b15e7b8e67 2023-03-30 16:54:45,146 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/352c318d46924ae3a9639220b79c3a69_SeqId_46_ 2023-03-30 16:54:45,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-30 16:54:45,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:45,151 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: f0fc9e1c2a385007d6f3a1a6db901efe to self. 2023-03-30 16:54:45,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=CLOSED 2023-03-30 16:54:45,153 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195285153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195285153"}]},"ts":"1680195285153"} 2023-03-30 16:54:45,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-30 16:54:45,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375 in 245 msec 2023-03-30 16:54:45,156 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=true 2023-03-30 16:54:45,306 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:45,306 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195285306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195285306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195285306"}]},"ts":"1680195285306"} 2023-03-30 16:54:45,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:45,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0fc9e1c2a385007d6f3a1a6db901efe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,464 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,465 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:45,465 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1 2023-03-30 16:54:45,466 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0fc9e1c2a385007d6f3a1a6db901efe columnFamilyName family1 2023-03-30 16:54:45,470 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/41b7958bda53430cbef21f6bf283ed61_SeqId_52_ 2023-03-30 16:54:45,473 DEBUG [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/family1/7f7fee2a02ac4e278fd600ab16e6e341 2023-03-30 16:54:45,473 INFO [StoreOpener-f0fc9e1c2a385007d6f3a1a6db901efe-1] regionserver.HStore(310): Store=f0fc9e1c2a385007d6f3a1a6db901efe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:45,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:54:45,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f0fc9e1c2a385007d6f3a1a6db901efe; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65283600, jitterRate=-0.02719855308532715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:45,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:54:45,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe., pid=69, masterSystemTime=1680195285460 2023-03-30 16:54:45,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:54:45,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0fc9e1c2a385007d6f3a1a6db901efe, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:45,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680195285481"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195285481"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195285481"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195285481"}]},"ts":"1680195285481"} 2023-03-30 16:54:45,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-30 16:54:45,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure f0fc9e1c2a385007d6f3a1a6db901efe, server=jenkins-hbase4.apache.org,39029,1680195214375 in 175 msec 2023-03-30 16:54:45,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-30 16:54:45,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f0fc9e1c2a385007d6f3a1a6db901efe, REOPEN/MOVE in 579 msec 2023-03-30 16:54:45,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-30 16:54:45,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 584 msec 2023-03-30 16:54:45,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 636 msec 2023-03-30 16:54:45,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-30 16:54:45,499 INFO [Listener at localhost/41799] compactions.TestMobCompactor(278): alter status finished 2023-03-30 16:54:45,500 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-30 16:54:45,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:45,503 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:45,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:45,503 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195885503 2023-03-30 16:54:45,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:54:45,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-30 16:54:45,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:45,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x10888d4f to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:45,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5797910b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:45,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-30 16:54:45,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-30 16:54:45,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:45,521 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-30 16:54:45,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 20 msec 2023-03-30 16:54:45,589 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=259 (was 249) - Thread LEAK? -, OpenFileDescriptor=654 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=433 (was 371) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4590 (was 4634) 2023-03-30 16:54:45,602 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=259, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=433, ProcessCount=169, AvailableMemoryMB=4589 2023-03-30 16:54:45,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-30 16:54:45,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:45,608 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:54:45,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-30 16:54:45,609 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:54:45,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-30 16:54:45,611 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:45,612 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917 empty. 2023-03-30 16:54:45,612 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:45,612 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-30 16:54:45,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-30 16:54:45,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-30 16:54:46,021 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:46,022 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => a7d1472badc6411bb64d596ac8235917, NAME => 'testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:46,070 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:46,071 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing a7d1472badc6411bb64d596ac8235917, disabling compactions & flushes 2023-03-30 16:54:46,071 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:46,071 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:46,071 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. after waiting 0 ms 2023-03-30 16:54:46,071 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:46,071 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:46,071 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for a7d1472badc6411bb64d596ac8235917: 2023-03-30 16:54:46,074 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:54:46,075 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680195286075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195286075"}]},"ts":"1680195286075"} 2023-03-30 16:54:46,076 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:54:46,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:54:46,084 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195286084"}]},"ts":"1680195286084"} 2023-03-30 16:54:46,085 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-30 16:54:46,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a7d1472badc6411bb64d596ac8235917, ASSIGN}] 2023-03-30 16:54:46,091 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a7d1472badc6411bb64d596ac8235917, ASSIGN 2023-03-30 16:54:46,092 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=a7d1472badc6411bb64d596ac8235917, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:46,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-30 16:54:46,244 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a7d1472badc6411bb64d596ac8235917, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:46,244 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680195286244"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195286244"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195286244"}]},"ts":"1680195286244"} 2023-03-30 16:54:46,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure a7d1472badc6411bb64d596ac8235917, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:46,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:46,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7d1472badc6411bb64d596ac8235917, NAME => 'testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:54:46,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-30 16:54:46,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-30 16:54:46,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:46,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:46,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:46,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:46,404 INFO [StoreOpener-a7d1472badc6411bb64d596ac8235917-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:46,405 DEBUG [StoreOpener-a7d1472badc6411bb64d596ac8235917-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1 2023-03-30 16:54:46,405 DEBUG [StoreOpener-a7d1472badc6411bb64d596ac8235917-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1 2023-03-30 16:54:46,405 INFO [StoreOpener-a7d1472badc6411bb64d596ac8235917-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7d1472badc6411bb64d596ac8235917 columnFamilyName f1 2023-03-30 16:54:46,407 INFO [StoreOpener-a7d1472badc6411bb64d596ac8235917-1] regionserver.HStore(310): Store=a7d1472badc6411bb64d596ac8235917/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:46,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:46,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:46,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:46,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:46,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7d1472badc6411bb64d596ac8235917; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73890620, jitterRate=0.1010560393333435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:54:46,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7d1472badc6411bb64d596ac8235917: 2023-03-30 16:54:46,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917., pid=73, masterSystemTime=1680195286397 2023-03-30 16:54:46,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:46,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:46,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a7d1472badc6411bb64d596ac8235917, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:46,415 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680195286415"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195286415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195286415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195286415"}]},"ts":"1680195286415"} 2023-03-30 16:54:46,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-30 16:54:46,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure a7d1472badc6411bb64d596ac8235917, server=jenkins-hbase4.apache.org,39029,1680195214375 in 170 msec 2023-03-30 16:54:46,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-30 16:54:46,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=a7d1472badc6411bb64d596ac8235917, ASSIGN in 329 msec 2023-03-30 16:54:46,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:54:46,419 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195286419"}]},"ts":"1680195286419"} 2023-03-30 16:54:46,420 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-30 16:54:46,424 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:54:46,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 818 msec 2023-03-30 16:54:46,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-30 16:54:46,714 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-30 16:54:46,715 DEBUG [Listener at localhost/41799] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-30 16:54:46,717 INFO [Listener at localhost/41799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-30 16:54:46,720 INFO [Listener at localhost/41799] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-30 16:54:46,721 INFO [Listener at localhost/41799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-30 16:54:46,721 INFO [Listener at localhost/41799] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-30 16:54:46,750 INFO [Listener at localhost/41799] regionserver.HRegion(2745): Flushing a7d1472badc6411bb64d596ac8235917 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-30 16:54:47,179 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330d50c9e26cddf49b9bd44c54417982303 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230330d50c9e26cddf49b9bd44c54417982303 2023-03-30 16:54:47,202 INFO [Listener at localhost/41799] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/.tmp/f1/4b49667f6ba441008713b8a97741de95 2023-03-30 16:54:47,208 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/.tmp/f1/4b49667f6ba441008713b8a97741de95 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95 2023-03-30 16:54:47,213 INFO [Listener at localhost/41799] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95, entries=1, sequenceid=5, filesize=4.9 K 2023-03-30 16:54:47,214 INFO [Listener at localhost/41799] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for a7d1472badc6411bb64d596ac8235917 in 464ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:47,214 DEBUG [Listener at localhost/41799] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-30 16:54:47,215 DEBUG [Listener at localhost/41799] regionserver.HRegion(2446): Flush status journal for a7d1472badc6411bb64d596ac8235917: 2023-03-30 16:54:47,217 INFO [Listener at localhost/41799] regionserver.HRegion(2745): Flushing a7d1472badc6411bb64d596ac8235917 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-30 16:54:47,629 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303304bbbc52bf3484147b0a67f060f30bfcd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303304bbbc52bf3484147b0a67f060f30bfcd 2023-03-30 16:54:47,636 INFO [Listener at localhost/41799] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/.tmp/f1/8d433a8fdd3e4434b051837f38bf478a 2023-03-30 16:54:47,640 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/.tmp/f1/8d433a8fdd3e4434b051837f38bf478a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a 2023-03-30 16:54:47,644 INFO [Listener at localhost/41799] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a, entries=1, sequenceid=9, filesize=4.9 K 2023-03-30 16:54:47,646 INFO [Listener at localhost/41799] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for a7d1472badc6411bb64d596ac8235917 in 429ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:47,646 DEBUG [Listener at localhost/41799] regionserver.HRegion(2446): Flush status journal for a7d1472badc6411bb64d596ac8235917: 2023-03-30 16:54:47,647 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-30 16:54:47,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-30 16:54:47,649 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-30 16:54:47,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:47,650 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195887650 2023-03-30 16:54:47,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-30 16:54:47,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-30 16:54:47,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-30 16:54:47,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x615e3068 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:47,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a2afa81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:47,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230330 for table='testGetAfterCompaction' and column='f1' 2023-03-30 16:54:47,699 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,699 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,750 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,750 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,800 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,801 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,851 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,852 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,902 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,903 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,953 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:47,953 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,004 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,004 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,055 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,055 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,091 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330eb1429fda6614663bc4c79d77b178b34 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230330eb1429fda6614663bc4c79d77b178b34 2023-03-30 16:54:48,092 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testGetAfterCompaction' column='f1' 2023-03-30 16:54:48,106 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,106 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,110 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:48,112 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55398, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:48,118 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:54:48,120 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:54:48,129 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/f1/72afec6eb8b04aca8064d19209eb378e first=Optional[r1] last=Optional[r2] 2023-03-30 16:54:48,130 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{f1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/f1/72afec6eb8b04aca8064d19209eb378e}] 2023-03-30 16:54:48,134 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/f1/72afec6eb8b04aca8064d19209eb378e for inclusion in a7d1472badc6411bb64d596ac8235917/f1 2023-03-30 16:54:48,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-30 16:54:48,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:54:48,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for a7d1472badc6411bb64d596ac8235917: 2023-03-30 16:54:48,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/f1/72afec6eb8b04aca8064d19209eb378e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testGetAfterCompaction__dr57f21fhn5p9gsq6crahv20hrt3s8daet2k932rpe0d7ot7mu6gsbrkb68s9gsl/f1/72afec6eb8b04aca8064d19209eb378e 2023-03-30 16:54:48,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testGetAfterCompaction__dr57f21fhn5p9gsq6crahv20hrt3s8daet2k932rpe0d7ot7mu6gsbrkb68s9gsl/f1/72afec6eb8b04aca8064d19209eb378e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_ 2023-03-30 16:54:48,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testGetAfterCompaction__dr57f21fhn5p9gsq6crahv20hrt3s8daet2k932rpe0d7ot7mu6gsbrkb68s9gsl/f1/72afec6eb8b04aca8064d19209eb378e into a7d1472badc6411bb64d596ac8235917/f1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_ - updating store file list. 2023-03-30 16:54:48,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_ into a7d1472badc6411bb64d596ac8235917/f1 2023-03-30 16:54:48,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testGetAfterCompaction__dr57f21fhn5p9gsq6crahv20hrt3s8daet2k932rpe0d7ot7mu6gsbrkb68s9gsl/f1/72afec6eb8b04aca8064d19209eb378e into a7d1472badc6411bb64d596ac8235917/f1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_) 2023-03-30 16:54:48,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testGetAfterCompaction__dr57f21fhn5p9gsq6crahv20hrt3s8daet2k932rpe0d7ot7mu6gsbrkb68s9gsl/f1/72afec6eb8b04aca8064d19209eb378e 2023-03-30 16:54:48,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(1912): a7d1472badc6411bb64d596ac8235917/f1 is initiating minor compaction 2023-03-30 16:54:48,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@50a35855; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:48,144 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a7d1472badc6411bb64d596ac8235917/f1 in testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:48,144 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/.tmp, totalSize=10.0 K 2023-03-30 16:54:48,145 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting 8d433a8fdd3e4434b051837f38bf478a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:54:48,145 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:54:48,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testGetAfterCompaction' column='f1' 2023-03-30 16:54:48,147 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:48,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303304bbbc52bf3484147b0a67f060f30bfcd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303304bbbc52bf3484147b0a67f060f30bfcd 2023-03-30 16:54:48,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230330d50c9e26cddf49b9bd44c54417982303 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230330d50c9e26cddf49b9bd44c54417982303 2023-03-30 16:54:48,150 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-30 16:54:48,150 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230330' 2023-03-30 16:54:48,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230330 for table='testGetAfterCompaction' and column='f1' 2023-03-30 16:54:48,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-30 16:54:48,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:54:48,152 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-30 16:54:48,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 504 msec 2023-03-30 16:54:48,157 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): a7d1472badc6411bb64d596ac8235917#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:54:48,157 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,158 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,158 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680195288086; access_time=1680195287670; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-30 16:54:48,169 DEBUG [Listener at localhost/41799] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-30 16:54:48,185 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55400, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-30 16:54:48,185 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39029] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:48,186 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-30 16:54:48,186 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-30 16:54:48,186 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39029] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-30 16:54:48,186 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39029] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. because compaction request was cancelled 2023-03-30 16:54:48,204 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/.tmp/f1/3ae53f77a7da4dc4821cc8e1e7380c40 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/3ae53f77a7da4dc4821cc8e1e7380c40 2023-03-30 16:54:48,209 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in a7d1472badc6411bb64d596ac8235917/f1 of a7d1472badc6411bb64d596ac8235917 into 3ae53f77a7da4dc4821cc8e1e7380c40(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:54:48,209 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a7d1472badc6411bb64d596ac8235917: 2023-03-30 16:54:48,209 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1680195288144; duration=0sec 2023-03-30 16:54:48,209 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:54:48,238 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/3ae53f77a7da4dc4821cc8e1e7380c40; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680195288197; access_time=1680195288154; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,238 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,238 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287636; access_time=1680195287219; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,238 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680195288086; access_time=1680195287670; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-30 16:54:48,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_] to archive 2023-03-30 16:54:48,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:54:48,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/8d433a8fdd3e4434b051837f38bf478a 2023-03-30 16:54:48,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/a37044cdbe7b4939b3f239c5f7a2b802_SeqId_12_ 2023-03-30 16:54:48,289 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/3ae53f77a7da4dc4821cc8e1e7380c40; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680195288197; access_time=1680195288154; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,289 INFO [Listener at localhost/41799] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680195287202; access_time=1680195286754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-30 16:54:48,418 INFO [Listener at localhost/41799] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-30 16:54:48,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-03-30 16:54:48,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:48,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195288435"}]},"ts":"1680195288435"} 2023-03-30 16:54:48,437 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-30 16:54:48,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-30 16:54:48,440 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-30 16:54:48,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a7d1472badc6411bb64d596ac8235917, UNASSIGN}] 2023-03-30 16:54:48,443 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a7d1472badc6411bb64d596ac8235917, UNASSIGN 2023-03-30 16:54:48,443 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a7d1472badc6411bb64d596ac8235917, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:48,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680195288443"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195288443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195288443"}]},"ts":"1680195288443"} 2023-03-30 16:54:48,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure a7d1472badc6411bb64d596ac8235917, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:48,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-30 16:54:48,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:48,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7d1472badc6411bb64d596ac8235917, disabling compactions & flushes 2023-03-30 16:54:48,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:48,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:48,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. after waiting 0 ms 2023-03-30 16:54:48,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:48,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-30 16:54:48,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-30 16:54:48,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917. 2023-03-30 16:54:48,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7d1472badc6411bb64d596ac8235917: 2023-03-30 16:54:48,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:48,605 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a7d1472badc6411bb64d596ac8235917, regionState=CLOSED 2023-03-30 16:54:48,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680195288605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195288605"}]},"ts":"1680195288605"} 2023-03-30 16:54:48,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-30 16:54:48,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure a7d1472badc6411bb64d596ac8235917, server=jenkins-hbase4.apache.org,39029,1680195214375 in 162 msec 2023-03-30 16:54:48,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-30 16:54:48,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=a7d1472badc6411bb64d596ac8235917, UNASSIGN in 168 msec 2023-03-30 16:54:48,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195288611"}]},"ts":"1680195288611"} 2023-03-30 16:54:48,612 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-30 16:54:48,614 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-30 16:54:48,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 188 msec 2023-03-30 16:54:48,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-30 16:54:48,741 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-30 16:54:48,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-03-30 16:54:48,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:48,754 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:48,756 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:48,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-30 16:54:48,768 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:48,771 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1, FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/recovered.edits] 2023-03-30 16:54:48,779 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/3ae53f77a7da4dc4821cc8e1e7380c40 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/3ae53f77a7da4dc4821cc8e1e7380c40 2023-03-30 16:54:48,783 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/f1/4b49667f6ba441008713b8a97741de95 2023-03-30 16:54:48,786 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/recovered.edits/15.seqid to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917/recovered.edits/15.seqid 2023-03-30 16:54:48,786 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testGetAfterCompaction/a7d1472badc6411bb64d596ac8235917 2023-03-30 16:54:48,787 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-30 16:54:48,787 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-30 16:54:48,788 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-30 16:54:48,791 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230330eb1429fda6614663bc4c79d77b178b34 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230330eb1429fda6614663bc4c79d77b178b34 2023-03-30 16:54:48,792 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-30 16:54:48,795 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:48,824 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-30 16:54:48,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-30 16:54:48,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:48,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-30 16:54:48,829 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680195288829"}]},"ts":"9223372036854775807"} 2023-03-30 16:54:48,831 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-30 16:54:48,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a7d1472badc6411bb64d596ac8235917, NAME => 'testGetAfterCompaction,,1680195285605.a7d1472badc6411bb64d596ac8235917.', STARTKEY => '', ENDKEY => ''}] 2023-03-30 16:54:48,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-30 16:54:48,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1680195288831"}]},"ts":"9223372036854775807"} 2023-03-30 16:54:48,834 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-30 16:54:48,838 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-30 16:54:48,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 91 msec 2023-03-30 16:54:48,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-30 16:54:48,858 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-30 16:54:48,876 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=262 (was 259) - Thread LEAK? -, OpenFileDescriptor=660 (was 654) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=433 (was 433), ProcessCount=169 (was 169), AvailableMemoryMB=4578 (was 4589) 2023-03-30 16:54:48,890 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=262, OpenFileDescriptor=660, MaxFileDescriptor=60000, SystemLoadAverage=433, ProcessCount=169, AvailableMemoryMB=4577 2023-03-30 16:54:48,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-30 16:54:48,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-30 16:54:48,894 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:54:48,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-30 16:54:48,895 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:54:48,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-30 16:54:48,897 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:48,898 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:48,900 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3 empty. 2023-03-30 16:54:48,900 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:48,900 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325 empty. 2023-03-30 16:54:48,901 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:48,901 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:48,901 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6 empty. 2023-03-30 16:54:48,901 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:48,901 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-30 16:54:48,918 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-30 16:54:48,919 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => b29fad251876ccdb28c1e80a93ea7325, NAME => 'testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:48,921 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => fadbe83bb5f1f6bef301518ccc05dca3, NAME => 'testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:48,928 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 80c0ffabf06d7dad81c5f34fac612af6, NAME => 'testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:54:48,980 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:48,980 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing fadbe83bb5f1f6bef301518ccc05dca3, disabling compactions & flushes 2023-03-30 16:54:48,980 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:48,980 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:48,980 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. after waiting 0 ms 2023-03-30 16:54:48,980 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:48,980 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:48,980 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:48,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-30 16:54:49,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-30 16:54:49,369 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:49,369 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing b29fad251876ccdb28c1e80a93ea7325, disabling compactions & flushes 2023-03-30 16:54:49,369 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:49,369 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:49,369 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. after waiting 0 ms 2023-03-30 16:54:49,369 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:49,370 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:49,370 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:49,386 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:49,386 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 80c0ffabf06d7dad81c5f34fac612af6, disabling compactions & flushes 2023-03-30 16:54:49,386 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:49,386 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:49,386 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. after waiting 0 ms 2023-03-30 16:54:49,387 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:49,387 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:49,387 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:49,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:54:49,392 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195289392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195289392"}]},"ts":"1680195289392"} 2023-03-30 16:54:49,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195289392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195289392"}]},"ts":"1680195289392"} 2023-03-30 16:54:49,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195289392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195289392"}]},"ts":"1680195289392"} 2023-03-30 16:54:49,398 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-30 16:54:49,399 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:54:49,399 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195289399"}]},"ts":"1680195289399"} 2023-03-30 16:54:49,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-30 16:54:49,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN}] 2023-03-30 16:54:49,407 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN 2023-03-30 16:54:49,408 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN 2023-03-30 16:54:49,408 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN 2023-03-30 16:54:49,408 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:49,409 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:49,409 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:54:49,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-30 16:54:49,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=80c0ffabf06d7dad81c5f34fac612af6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:49,560 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=b29fad251876ccdb28c1e80a93ea7325, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:49,560 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=fadbe83bb5f1f6bef301518ccc05dca3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:49,561 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195289560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195289560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195289560"}]},"ts":"1680195289560"} 2023-03-30 16:54:49,561 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195289560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195289560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195289560"}]},"ts":"1680195289560"} 2023-03-30 16:54:49,561 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195289560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195289560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195289560"}]},"ts":"1680195289560"} 2023-03-30 16:54:49,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure fadbe83bb5f1f6bef301518ccc05dca3, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:49,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 80c0ffabf06d7dad81c5f34fac612af6, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:49,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure b29fad251876ccdb28c1e80a93ea7325, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:54:49,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:49,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b29fad251876ccdb28c1e80a93ea7325, NAME => 'testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.', STARTKEY => '', ENDKEY => '1'} 2023-03-30 16:54:49,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:49,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,733 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,735 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:54:49,735 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:54:49,736 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29fad251876ccdb28c1e80a93ea7325 columnFamilyName family1 2023-03-30 16:54:49,738 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(310): Store=b29fad251876ccdb28c1e80a93ea7325/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:49,738 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,741 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2 2023-03-30 16:54:49,741 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2 2023-03-30 16:54:49,741 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29fad251876ccdb28c1e80a93ea7325 columnFamilyName family2 2023-03-30 16:54:49,743 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(310): Store=b29fad251876ccdb28c1e80a93ea7325/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:49,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:54:49,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:54:49,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:49,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b29fad251876ccdb28c1e80a93ea7325; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63859274, jitterRate=-0.048422664403915405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:54:49,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:49,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325., pid=85, masterSystemTime=1680195289728 2023-03-30 16:54:49,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:49,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:49,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:49,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80c0ffabf06d7dad81c5f34fac612af6, NAME => 'testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.', STARTKEY => '2', ENDKEY => ''} 2023-03-30 16:54:49,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:49,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,756 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=b29fad251876ccdb28c1e80a93ea7325, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:49,757 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195289756"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195289756"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195289756"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195289756"}]},"ts":"1680195289756"} 2023-03-30 16:54:49,758 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-03-30 16:54:49,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure b29fad251876ccdb28c1e80a93ea7325, server=jenkins-hbase4.apache.org,39029,1680195214375 in 193 msec 2023-03-30 16:54:49,760 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:54:49,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN in 356 msec 2023-03-30 16:54:49,761 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:54:49,761 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80c0ffabf06d7dad81c5f34fac612af6 columnFamilyName family1 2023-03-30 16:54:49,764 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(310): Store=80c0ffabf06d7dad81c5f34fac612af6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:49,764 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,765 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2 2023-03-30 16:54:49,766 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2 2023-03-30 16:54:49,766 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80c0ffabf06d7dad81c5f34fac612af6 columnFamilyName family2 2023-03-30 16:54:49,767 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(310): Store=80c0ffabf06d7dad81c5f34fac612af6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:49,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:54:49,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:54:49,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:49,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80c0ffabf06d7dad81c5f34fac612af6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66532293, jitterRate=-0.008591577410697937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:54:49,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:49,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6., pid=84, masterSystemTime=1680195289728 2023-03-30 16:54:49,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:49,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:49,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:49,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fadbe83bb5f1f6bef301518ccc05dca3, NAME => 'testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.', STARTKEY => '1', ENDKEY => '2'} 2023-03-30 16:54:49,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:54:49,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,784 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=80c0ffabf06d7dad81c5f34fac612af6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:49,784 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195289784"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195289784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195289784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195289784"}]},"ts":"1680195289784"} 2023-03-30 16:54:49,785 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,787 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:54:49,787 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:54:49,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-03-30 16:54:49,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 80c0ffabf06d7dad81c5f34fac612af6, server=jenkins-hbase4.apache.org,39029,1680195214375 in 222 msec 2023-03-30 16:54:49,788 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fadbe83bb5f1f6bef301518ccc05dca3 columnFamilyName family1 2023-03-30 16:54:49,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN in 382 msec 2023-03-30 16:54:49,789 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(310): Store=fadbe83bb5f1f6bef301518ccc05dca3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:49,790 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,791 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2 2023-03-30 16:54:49,791 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2 2023-03-30 16:54:49,791 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fadbe83bb5f1f6bef301518ccc05dca3 columnFamilyName family2 2023-03-30 16:54:49,792 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(310): Store=fadbe83bb5f1f6bef301518ccc05dca3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:54:49,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:54:49,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:54:49,797 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:54:49,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:54:49,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fadbe83bb5f1f6bef301518ccc05dca3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70875919, jitterRate=0.05613349378108978}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:54:49,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:49,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3., pid=83, masterSystemTime=1680195289728 2023-03-30 16:54:49,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:49,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:49,806 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=fadbe83bb5f1f6bef301518ccc05dca3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:49,806 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195289806"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195289806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195289806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195289806"}]},"ts":"1680195289806"} 2023-03-30 16:54:49,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-03-30 16:54:49,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure fadbe83bb5f1f6bef301518ccc05dca3, server=jenkins-hbase4.apache.org,39029,1680195214375 in 247 msec 2023-03-30 16:54:49,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-03-30 16:54:49,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN in 406 msec 2023-03-30 16:54:49,813 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:54:49,814 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195289813"}]},"ts":"1680195289813"} 2023-03-30 16:54:49,815 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-30 16:54:49,818 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:54:49,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 926 msec 2023-03-30 16:54:49,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-30 16:54:50,000 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-30 16:54:50,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:50,050 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:50,051 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:50,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:50,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-30 16:54:50,072 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-30 16:54:50,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:50,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-30 16:54:50,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-30 16:54:50,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:50,073 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:50,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:50,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:50,074 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:50,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:50,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:50,074 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:50,075 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:50,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:50,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:50,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:50,076 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-30 16:54:50,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-30 16:54:50,080 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-30 16:54:50,080 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:50,080 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-30 16:54:50,084 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:50,084 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. started... 2023-03-30 16:54:50,088 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:54:50,092 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:50,092 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. started... 2023-03-30 16:54:50,092 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:50,092 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80c0ffabf06d7dad81c5f34fac612af6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:54:50,092 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:50,093 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b29fad251876ccdb28c1e80a93ea7325 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:54:50,093 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. started... 2023-03-30 16:54:50,094 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fadbe83bb5f1f6bef301518ccc05dca3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:54:50,534 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e 2023-03-30 16:54:50,542 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 2023-03-30 16:54:50,543 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/e1ecf56a9bf7486593b3a778f4568014 2023-03-30 16:54:50,546 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 2023-03-30 16:54:50,555 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/b998173087ec48779c5edea886d3e46c 2023-03-30 16:54:50,558 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/091aa93aed084f5cadfe48960fd07f31 2023-03-30 16:54:50,573 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303302ad1550b092d4583ac4b04b42ee93e67 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303302ad1550b092d4583ac4b04b42ee93e67 2023-03-30 16:54:50,965 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033098d5bb92cbba4d4997aef88e0b82dc7a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033098d5bb92cbba4d4997aef88e0b82dc7a 2023-03-30 16:54:50,990 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/3fb881c8bc334617895ab7d9c73d5476 2023-03-30 16:54:50,996 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330262847b1206d4e5eab9a1cd75a27fd76 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330262847b1206d4e5eab9a1cd75a27fd76 2023-03-30 16:54:50,997 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/b998173087ec48779c5edea886d3e46c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c 2023-03-30 16:54:51,008 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c, entries=4, sequenceid=5, filesize=5.4 K 2023-03-30 16:54:51,008 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/c5edef28457646a8be5e2fb7168ec592 2023-03-30 16:54:51,010 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/3fb881c8bc334617895ab7d9c73d5476 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476 2023-03-30 16:54:51,019 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/e1ecf56a9bf7486593b3a778f4568014 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014 2023-03-30 16:54:51,023 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:54:51,025 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014, entries=4, sequenceid=5, filesize=5.4 K 2023-03-30 16:54:51,032 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/c5edef28457646a8be5e2fb7168ec592 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592 2023-03-30 16:54:51,034 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 80c0ffabf06d7dad81c5f34fac612af6 in 942ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:51,034 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-30 16:54:51,036 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:51,036 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:51,036 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:54:51,037 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/c9d7402570734810ba9dcd4014768215 2023-03-30 16:54:51,043 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:54:51,043 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/091aa93aed084f5cadfe48960fd07f31 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31 2023-03-30 16:54:51,045 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fadbe83bb5f1f6bef301518ccc05dca3 in 951ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:51,047 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:51,047 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:51,047 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:54:51,049 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31, entries=4, sequenceid=5, filesize=5.4 K 2023-03-30 16:54:51,050 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/c9d7402570734810ba9dcd4014768215 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215 2023-03-30 16:54:51,054 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:54:51,055 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b29fad251876ccdb28c1e80a93ea7325 in 962ms, sequenceid=5, compaction requested=false 2023-03-30 16:54:51,055 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:51,055 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:51,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:54:51,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:54:51,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-30 16:54:51,056 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-30 16:54:51,058 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,059 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:51,059 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,059 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:51,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-30 16:54:51,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e4a31cd[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:51,061 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-30 16:54:51,061 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,062 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,062 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,062 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:51,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-30 16:54:51,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-30 16:54:51,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:51,064 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-30 16:54:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-30 16:54:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:51,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-30 16:54:51,067 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-30 16:54:51,067 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:51,067 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:51,067 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-30 16:54:51,067 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:51,068 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,068 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,068 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:51,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:51,069 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,070 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:51,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:51,074 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:51,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-30 16:54:51,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:51,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:51,075 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:51,075 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:51,175 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:51,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:51,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:51,178 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:51,178 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:51,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:51,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:51,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-30 16:54:51,183 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-30 16:54:51,183 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:51,183 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-30 16:54:51,183 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-30 16:54:51,183 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,183 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:51,184 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:51,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:51,185 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:51,185 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:51,185 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:51,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:51,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:51,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:51,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:51,186 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-30 16:54:51,186 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-30 16:54:51,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-30 16:54:51,186 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-30 16:54:51,186 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:51,186 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-30 16:54:51,187 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:51,187 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:51,187 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. started... 2023-03-30 16:54:51,187 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. started... 2023-03-30 16:54:51,187 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80c0ffabf06d7dad81c5f34fac612af6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:54:51,187 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fadbe83bb5f1f6bef301518ccc05dca3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:54:51,188 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:54:51,188 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:51,188 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:51,188 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. started... 2023-03-30 16:54:51,189 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b29fad251876ccdb28c1e80a93ea7325 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:54:51,239 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 2023-03-30 16:54:51,240 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad 2023-03-30 16:54:51,241 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a 2023-03-30 16:54:51,256 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/32fea8bf809d45dda6acde20dc39e115 2023-03-30 16:54:51,654 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/4361876fef7d4de18308a6c1a4058898 2023-03-30 16:54:51,664 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/1588d3d561964f8fb1984959c783dc2e 2023-03-30 16:54:51,678 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330ffc2d363c76c4c94b2c100c3ed8d1f50 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330ffc2d363c76c4c94b2c100c3ed8d1f50 2023-03-30 16:54:51,687 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/2a01493e7d074b0a8e262d90492ba9e3 2023-03-30 16:54:51,692 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/32fea8bf809d45dda6acde20dc39e115 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115 2023-03-30 16:54:51,696 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115, entries=4, sequenceid=9, filesize=5.4 K 2023-03-30 16:54:51,697 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/2a01493e7d074b0a8e262d90492ba9e3 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3 2023-03-30 16:54:51,700 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:54:51,701 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fadbe83bb5f1f6bef301518ccc05dca3 in 514ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:51,701 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:51,701 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:51,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:54:52,074 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303305235f78374d24ac6a9c9237416c30f49 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303305235f78374d24ac6a9c9237416c30f49 2023-03-30 16:54:52,082 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/69176da70273463d95453168043d8aed 2023-03-30 16:54:52,087 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/4361876fef7d4de18308a6c1a4058898 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898 2023-03-30 16:54:52,090 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033035d255f55fd942b68c43910752c983c2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033035d255f55fd942b68c43910752c983c2 2023-03-30 16:54:52,096 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898, entries=4, sequenceid=9, filesize=5.4 K 2023-03-30 16:54:52,097 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/69176da70273463d95453168043d8aed as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed 2023-03-30 16:54:52,106 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/58bbbd976dbb48b086469c4589270ab3 2023-03-30 16:54:52,114 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:54:52,115 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 80c0ffabf06d7dad81c5f34fac612af6 in 928ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:52,115 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:52,115 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:52,115 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:54:52,116 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/1588d3d561964f8fb1984959c783dc2e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e 2023-03-30 16:54:52,120 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e, entries=4, sequenceid=9, filesize=5.4 K 2023-03-30 16:54:52,121 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/58bbbd976dbb48b086469c4589270ab3 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3 2023-03-30 16:54:52,126 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:54:52,127 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b29fad251876ccdb28c1e80a93ea7325 in 938ms, sequenceid=9, compaction requested=false 2023-03-30 16:54:52,127 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:52,127 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:52,127 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:54:52,127 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:54:52,127 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,127 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-30 16:54:52,127 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-30 16:54:52,129 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,129 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:52,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:52,130 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,130 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:52,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-30 16:54:52,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c511bea[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:52,131 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-30 16:54:52,131 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,133 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,133 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-30 16:54:52,133 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-30 16:54:52,133 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:52,133 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,134 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:52,135 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,135 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-30 16:54:52,135 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:52,135 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-30 16:54:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:52,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-30 16:54:52,138 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-30 16:54:52,138 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:52,138 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:52,138 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-30 16:54:52,138 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:52,141 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,141 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:52,141 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:52,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:52,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:52,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,142 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:52,145 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,147 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,147 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:52,147 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:52,147 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,147 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,148 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:52,148 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,148 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:52,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-30 16:54:52,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-30 16:54:52,148 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:52,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:52,148 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:52,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:52,148 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:52,148 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:52,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:52,248 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:52,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:52,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:52,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:52,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:52,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:52,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:52,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-30 16:54:52,256 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-30 16:54:52,256 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:52,257 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-30 16:54:52,257 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-30 16:54:52,257 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,257 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:52,258 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,258 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:52,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:52,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:52,259 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:52,259 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:52,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:52,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:52,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:52,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:52,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-30 16:54:52,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-30 16:54:52,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-30 16:54:52,260 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-30 16:54:52,260 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:52,260 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-30 16:54:52,260 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:52,260 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:52,260 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:54:52,261 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:52,260 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. started... 2023-03-30 16:54:52,261 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:52,261 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. started... 2023-03-30 16:54:52,261 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80c0ffabf06d7dad81c5f34fac612af6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:54:52,261 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. started... 2023-03-30 16:54:52,261 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b29fad251876ccdb28c1e80a93ea7325 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:54:52,261 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fadbe83bb5f1f6bef301518ccc05dca3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:54:52,303 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 2023-03-30 16:54:52,690 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d 2023-03-30 16:54:52,693 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff 2023-03-30 16:54:52,700 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/2416e084ca9b4a9085ea7fde70748dfa 2023-03-30 16:54:52,709 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/ca6332d0876048a18f6b383e8d554f52 2023-03-30 16:54:52,716 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303308c80ae6d1a7e453f98c417e57b556f13 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303308c80ae6d1a7e453f98c417e57b556f13 2023-03-30 16:54:52,724 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/1e672f4517804adc98af82b6a72d68c4 2023-03-30 16:54:52,729 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/2416e084ca9b4a9085ea7fde70748dfa as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa 2023-03-30 16:54:52,732 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa, entries=4, sequenceid=13, filesize=5.4 K 2023-03-30 16:54:52,733 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/1e672f4517804adc98af82b6a72d68c4 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4 2023-03-30 16:54:52,737 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:54:52,738 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fadbe83bb5f1f6bef301518ccc05dca3 in 477ms, sequenceid=13, compaction requested=true 2023-03-30 16:54:52,738 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:52,738 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:52,738 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:54:53,100 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/d3574393c7ea457bbe327b83f1099447 2023-03-30 16:54:53,115 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330835369fef7d24e47a888bf55d11dac08 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230330835369fef7d24e47a888bf55d11dac08 2023-03-30 16:54:53,128 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303305e461d4512a4405894a810331f347f23 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303305e461d4512a4405894a810331f347f23 2023-03-30 16:54:53,521 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f 2023-03-30 16:54:53,526 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/d3574393c7ea457bbe327b83f1099447 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447 2023-03-30 16:54:53,530 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447, entries=4, sequenceid=13, filesize=5.4 K 2023-03-30 16:54:53,531 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f 2023-03-30 16:54:53,533 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/f94fbf93d5934e278bbb9055d5d09de1 2023-03-30 16:54:53,536 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:54:53,537 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 80c0ffabf06d7dad81c5f34fac612af6 in 1275ms, sequenceid=13, compaction requested=true 2023-03-30 16:54:53,537 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:53,537 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:54:53,539 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/ca6332d0876048a18f6b383e8d554f52 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52 2023-03-30 16:54:53,545 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52, entries=4, sequenceid=13, filesize=5.4 K 2023-03-30 16:54:53,546 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/f94fbf93d5934e278bbb9055d5d09de1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1 2023-03-30 16:54:53,554 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:54:53,555 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b29fad251876ccdb28c1e80a93ea7325 in 1294ms, sequenceid=13, compaction requested=true 2023-03-30 16:54:53,555 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:53,555 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:53,555 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:54:53,555 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:54:53,555 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,555 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-30 16:54:53,555 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-30 16:54:53,558 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,558 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:53,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:53,559 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,559 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:53,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:53,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-30 16:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48e96927[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:53,561 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-30 16:54:53,561 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,562 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-30 16:54:53,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-30 16:54:53,562 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,562 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:53,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:53,564 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,564 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-30 16:54:53,564 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:53,564 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-30 16:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:53,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-30 16:54:53,567 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-30 16:54:53,567 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:53,567 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:53,567 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-30 16:54:53,567 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:53,569 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,569 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:53,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,569 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:53,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,570 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,572 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:53,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,580 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:53,580 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:53,580 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:53,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:53,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-30 16:54:53,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:53,580 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:53,580 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:53,581 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:53,581 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,581 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,581 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:53,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:53,581 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:53,581 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,581 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:53,681 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:53,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:53,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:53,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:53,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:54:53,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:53,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:53,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-30 16:54:53,689 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-30 16:54:53,689 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:53,689 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-30 16:54:53,689 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-30 16:54:53,689 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,689 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:53,690 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,691 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:53,691 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:53,692 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:53,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:53,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:53,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-30 16:54:53,693 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-30 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-30 16:54:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-30 16:54:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:53,694 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-30 16:54:53,701 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:53,701 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. started... 2023-03-30 16:54:53,701 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80c0ffabf06d7dad81c5f34fac612af6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:54:53,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:54:53,702 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:53,702 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:53,702 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:53,702 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. started... 2023-03-30 16:54:53,702 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. started... 2023-03-30 16:54:53,702 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fadbe83bb5f1f6bef301518ccc05dca3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:54:53,702 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b29fad251876ccdb28c1e80a93ea7325 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:54:54,132 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 2023-03-30 16:54:54,134 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 2023-03-30 16:54:54,138 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/08a97a760b30471d8c4211df06c9e751 2023-03-30 16:54:54,142 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee 2023-03-30 16:54:54,144 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 2023-03-30 16:54:54,160 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303301ba4f06940294e04b51c4422aa945edb to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303301ba4f06940294e04b51c4422aa945edb 2023-03-30 16:54:54,162 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330d95136a09f1c48ca954e50dd5c8a2062 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330d95136a09f1c48ca954e50dd5c8a2062 2023-03-30 16:54:54,174 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/5a5823e4e3754e33865bde221fd7f296 2023-03-30 16:54:54,179 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/08a97a760b30471d8c4211df06c9e751 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751 2023-03-30 16:54:54,183 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/64aa8daea9b84bdb88e24bd759e29f59 2023-03-30 16:54:54,184 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751, entries=4, sequenceid=17, filesize=5.4 K 2023-03-30 16:54:54,185 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/5a5823e4e3754e33865bde221fd7f296 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296 2023-03-30 16:54:54,190 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:54:54,191 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 80c0ffabf06d7dad81c5f34fac612af6 in 490ms, sequenceid=17, compaction requested=true 2023-03-30 16:54:54,192 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:54,192 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:54,192 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:54:54,198 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee 2023-03-30 16:54:54,202 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee, entries=4, sequenceid=17, filesize=5.4 K 2023-03-30 16:54:54,203 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/64aa8daea9b84bdb88e24bd759e29f59 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59 2023-03-30 16:54:54,207 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:54:54,208 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fadbe83bb5f1f6bef301518ccc05dca3 in 506ms, sequenceid=17, compaction requested=true 2023-03-30 16:54:54,208 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:54,208 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:54,208 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:54:54,559 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/3fea413fcc6f43bfa48d5e9628ba6a8e 2023-03-30 16:54:54,989 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033085c3c7b4b50f445aa008c0dd5569ec70 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033085c3c7b4b50f445aa008c0dd5569ec70 2023-03-30 16:54:55,234 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:54:55,357 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:55,357 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f84e5dd to 127.0.0.1:64100 2023-03-30 16:54:55,357 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,357 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10888d4f to 127.0.0.1:64100 2023-03-30 16:54:55,357 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,357 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:55,357 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x615e3068 to 127.0.0.1:64100 2023-03-30 16:54:55,357 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,357 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:55,358 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e23e41a to 127.0.0.1:64100 2023-03-30 16:54:55,358 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,358 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:55,358 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cf09208 to 127.0.0.1:64100 2023-03-30 16:54:55,358 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,358 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dae3683 to 127.0.0.1:64100 2023-03-30 16:54:55,358 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,358 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:54:55,358 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45bef4e9 to 127.0.0.1:64100 2023-03-30 16:54:55,358 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,396 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/271513167c8342c5999637e89a2323f3 2023-03-30 16:54:55,401 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/3fea413fcc6f43bfa48d5e9628ba6a8e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e 2023-03-30 16:54:55,405 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e, entries=4, sequenceid=17, filesize=5.4 K 2023-03-30 16:54:55,406 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/271513167c8342c5999637e89a2323f3 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3 2023-03-30 16:54:55,411 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:54:55,412 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b29fad251876ccdb28c1e80a93ea7325 in 1710ms, sequenceid=17, compaction requested=true 2023-03-30 16:54:55,412 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:55,412 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:54:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:54:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-30 16:54:55,412 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-30 16:54:55,561 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:55,561 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:55,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,562 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:55,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-30 16:54:55,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c5d9661[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:55,563 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-30 16:54:55,564 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,566 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-30 16:54:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-30 16:54:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:55,567 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,567 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:55,568 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-30 16:54:55,568 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:55,568 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,568 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-30 16:54:55,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:55,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:55,571 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-30 16:54:55,571 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:55,571 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:55,571 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-30 16:54:55,571 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:55,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-30 16:54:55,573 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:55,573 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:55,573 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:55,573 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:55,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:55,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:55,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:55,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:55,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:55,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:55,574 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:55,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:55,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:55,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,577 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,577 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:55,577 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:55,577 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:55,577 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:55,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-30 16:54:55,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:55,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:55,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-30 16:54:55,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:55,577 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:55,577 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:55,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:55,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:55,578 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,578 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:55,578 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:55,578 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:55,578 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:55,678 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:55,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:55,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-30 16:54:55,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1680195295693 (current time:1680195295693). 2023-03-30 16:54:55,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-30 16:54:55,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] zookeeper.ReadOnlyZKClient(139): Connect 0x3ca30185 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:54:55,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c1ed049, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:54:55,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:54:55,709 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:54:55,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ca30185 to 127.0.0.1:64100 2023-03-30 16:54:55,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:54:55,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-30 16:54:55,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-30 16:54:55,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-30 16:54:55,724 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-30 16:54:55,724 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1680195895724 2023-03-30 16:54:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-30 16:54:55,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1680195295679 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-30 16:54:55,729 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-30 16:54:55,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-30 16:54:55,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 7 msec 2023-03-30 16:54:55,731 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-30 16:54:55,732 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1680195895732 2023-03-30 16:54:55,734 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:55,734 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-30 16:54:55,834 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:54:55,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:54:55,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:54:55,839 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-30 16:54:56,039 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:54:56,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:54:56,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:54:56,040 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-30 16:54:56,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1680195295679 2023-03-30 16:54:56,146 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1680195295679' 2023-03-30 16:54:56,146 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-30 16:54:56,146 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1680195295679' starting 'acquire' 2023-03-30 16:54:56,146 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1680195295679', kicking off acquire phase on members. 2023-03-30 16:54:56,147 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,147 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1680195295679 2023-03-30 16:54:56,148 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,148 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-30 16:54:56,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-30 16:54:56,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-30 16:54:56,149 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,149 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1680195295679 2023-03-30 16:54:56,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-30 16:54:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1680195295679 2023-03-30 16:54:56,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1680195295679 from table testCompactionWithHFileLink type FLUSH 2023-03-30 16:54:56,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1680195295679 2023-03-30 16:54:56,152 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1680195295679' with timeout 300000ms 2023-03-30 16:54:56,152 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-30 16:54:56,152 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1680195295679' starting 'acquire' stage 2023-03-30 16:54:56,152 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1680195295679' locally acquired 2023-03-30 16:54:56,152 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (snaptb-1680195295679) in zk 2023-03-30 16:54:56,154 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,154 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:56,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-30 16:54:56,154 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,154 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1680195295679' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:56,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:56,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:56,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680195295679 2023-03-30 16:54:56,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:56,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'snaptb-1680195295679' on coordinator 2023-03-30 16:54:56,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7326027e[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:56,156 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1680195295679' starting 'in-barrier' execution. 2023-03-30 16:54:56,156 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,158 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,159 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,159 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1680195295679' received 'reached' from coordinator. 2023-03-30 16:54:56,164 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:56,165 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. started... 2023-03-30 16:54:56,165 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:56,166 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.' region-info for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,168 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:56,168 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. started... 2023-03-30 16:54:56,168 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:56,169 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.' region-info for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,169 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-30 16:54:56,169 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:56,169 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-30 16:54:56,169 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. started... 2023-03-30 16:54:56,169 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:56,169 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.' region-info for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,174 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-30 16:54:56,174 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-30 16:54:56,174 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-30 16:54:56,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee] hfiles 2023-03-30 16:54:56,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751] hfiles 2023-03-30 16:54:56,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e] hfiles 2023-03-30 16:54:56,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,178 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3] hfiles 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296] hfiles 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59] hfiles 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,184 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3 for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,340 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:54:56,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:54:56,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:54:56,342 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-30 16:54:56,599 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. completed. 2023-03-30 16:54:56,599 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:56,599 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. completed. 2023-03-30 16:54:56,599 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:56,599 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-30 16:54:56,599 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-30 16:54:56,606 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. completed. 2023-03-30 16:54:56,606 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:56,606 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-30 16:54:56,606 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-30 16:54:56,606 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,606 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1680195295679' locally completed 2023-03-30 16:54:56,606 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1680195295679' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1680195295679' has notified controller of completion 2023-03-30 16:54:56,608 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-30 16:54:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1680195295679' completed. 2023-03-30 16:54:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680195295679 2023-03-30 16:54:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680195295679 2023-03-30 16:54:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1680195295679' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:56,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'snaptb-1680195295679', counting down latch. Waiting for 0 more 2023-03-30 16:54:56,611 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1680195295679' execution completed 2023-03-30 16:54:56,611 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:56,611 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:56,611 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1680195295679 2023-03-30 16:54:56,611 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1680195295679including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-30 16:54:56,613 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,613 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-30 16:54:56,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,613 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-30 16:54:56,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-30 16:54:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-30 16:54:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,614 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680195295679 2023-03-30 16:54:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680195295679 2023-03-30 16:54:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,615 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680195295679 2023-03-30 16:54:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,619 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,619 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-30 16:54:56,619 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680195295679 2023-03-30 16:54:56,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-30 16:54:56,619 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:56,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1680195295679 because node does not exist (not an error) 2023-03-30 16:54:56,619 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680195295679 2023-03-30 16:54:56,619 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-30 16:54:56,620 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680195295679/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:56,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1680195295679 2023-03-30 16:54:56,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-30 16:54:56,620 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-30 16:54:56,620 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680195295679 2023-03-30 16:54:56,620 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680195295679 2023-03-30 16:54:56,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1680195295679 2023-03-30 16:54:56,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-30 16:54:56,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-30 16:54:56,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-30 16:54:56,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98] mob files 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 2023-03-30 16:54:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 2023-03-30 16:54:56,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303308c80ae6d1a7e453f98c417e57b556f13, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033098d5bb92cbba4d4997aef88e0b82dc7a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330d95136a09f1c48ca954e50dd5c8a2062, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330ffc2d363c76c4c94b2c100c3ed8d1f50, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303301ba4f06940294e04b51c4422aa945edb, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303302ad1550b092d4583ac4b04b42ee93e67, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303305235f78374d24ac6a9c9237416c30f49, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230330835369fef7d24e47a888bf55d11dac08, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330262847b1206d4e5eab9a1cd75a27fd76, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033035d255f55fd942b68c43910752c983c2, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303305e461d4512a4405894a810331f347f23, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033085c3c7b4b50f445aa008c0dd5569ec70] mob files 2023-03-30 16:54:56,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303308c80ae6d1a7e453f98c417e57b556f13 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033098d5bb92cbba4d4997aef88e0b82dc7a 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330d95136a09f1c48ca954e50dd5c8a2062 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330ffc2d363c76c4c94b2c100c3ed8d1f50 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303301ba4f06940294e04b51c4422aa945edb 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303302ad1550b092d4583ac4b04b42ee93e67 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303305235f78374d24ac6a9c9237416c30f49 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230330835369fef7d24e47a888bf55d11dac08 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330262847b1206d4e5eab9a1cd75a27fd76 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033035d255f55fd942b68c43910752c983c2 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303305e461d4512a4405894a810331f347f23 2023-03-30 16:54:56,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033085c3c7b4b50f445aa008c0dd5569ec70 2023-03-30 16:54:56,842 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:54:56,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:54:56,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:54:56,843 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-30 16:54:57,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1680195295679 2023-03-30 16:54:57,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/snaptb-1680195295679 2023-03-30 16:54:57,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/snaptb-1680195295679 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/snaptb-1680195295679 2023-03-30 16:54:57,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1680195295679 of table testCompactionWithHFileLink completed 2023-03-30 16:54:57,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/snaptb-1680195295679 2023-03-30 16:54:57,539 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/snaptb-1680195295679 2023-03-30 16:54:57,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1680195295679 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1680195295728Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1680195297030 (+1302 ms)Consolidate snapshot: snaptb-1680195295679 at 1680195297030Loading Region manifests for snaptb-1680195295679 at 1680195297031 (+1 ms)Writing data manifest for snaptb-1680195295679 at 1680195297046 (+15 ms)Verifying snapshot: snaptb-1680195295679 at 1680195297056 (+10 ms)Snapshot snaptb-1680195295679 of table testCompactionWithHFileLink completed at 1680195297539 (+483 ms) 2023-03-30 16:54:57,541 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-30 16:54:57,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.8120 sec 2023-03-30 16:54:57,843 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:54:57,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:54:57,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-30 16:54:57,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:54:57,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-30 16:54:57,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-30 16:54:57,872 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-30 16:54:57,872 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:57,872 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-30 16:54:57,872 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-30 16:54:57,873 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:57,873 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:57,874 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:57,874 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:57,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:57,874 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:57,874 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:54:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:57,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:54:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:57,875 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-30 16:54:57,875 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-30 16:54:57,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-30 16:54:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-30 16:54:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:54:57,876 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-30 16:54:57,876 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:57,876 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:54:57,876 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:54:57,876 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:57,876 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. started... 2023-03-30 16:54:57,876 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:57,876 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. started... 2023-03-30 16:54:57,876 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. started... 2023-03-30 16:54:57,876 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fadbe83bb5f1f6bef301518ccc05dca3 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:54:57,876 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b29fad251876ccdb28c1e80a93ea7325 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:54:57,876 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80c0ffabf06d7dad81c5f34fac612af6 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:54:58,692 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/da8a9b9c89854bbb8bc629c7e06be988 2023-03-30 16:54:58,692 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/3cf960c53eda4080ae35b3c95d0a027a 2023-03-30 16:54:58,692 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/a597d7f611ea4991a9bd1848a185efa8 2023-03-30 16:54:58,697 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a597d7f611ea4991a9bd1848a185efa8 2023-03-30 16:54:58,697 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da8a9b9c89854bbb8bc629c7e06be988 2023-03-30 16:54:58,697 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3cf960c53eda4080ae35b3c95d0a027a 2023-03-30 16:54:59,523 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/fab7bc4c1162407aa8ff1cc11e2c0eff 2023-03-30 16:54:59,523 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/91c3c6a2c80a4337937e078ae5f6ca19 2023-03-30 16:54:59,523 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/e6a651957cce415484c01772b50f7976 2023-03-30 16:54:59,526 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fab7bc4c1162407aa8ff1cc11e2c0eff 2023-03-30 16:54:59,527 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6a651957cce415484c01772b50f7976 2023-03-30 16:54:59,528 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/3cf960c53eda4080ae35b3c95d0a027a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3cf960c53eda4080ae35b3c95d0a027a 2023-03-30 16:54:59,528 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/a597d7f611ea4991a9bd1848a185efa8 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/a597d7f611ea4991a9bd1848a185efa8 2023-03-30 16:54:59,529 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91c3c6a2c80a4337937e078ae5f6ca19 2023-03-30 16:54:59,530 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/da8a9b9c89854bbb8bc629c7e06be988 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/da8a9b9c89854bbb8bc629c7e06be988 2023-03-30 16:54:59,531 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3cf960c53eda4080ae35b3c95d0a027a 2023-03-30 16:54:59,532 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3cf960c53eda4080ae35b3c95d0a027a, entries=3, sequenceid=24, filesize=5.0 K 2023-03-30 16:54:59,532 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a597d7f611ea4991a9bd1848a185efa8 2023-03-30 16:54:59,532 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/a597d7f611ea4991a9bd1848a185efa8, entries=3, sequenceid=24, filesize=5.0 K 2023-03-30 16:54:59,532 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/fab7bc4c1162407aa8ff1cc11e2c0eff as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/fab7bc4c1162407aa8ff1cc11e2c0eff 2023-03-30 16:54:59,533 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/e6a651957cce415484c01772b50f7976 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e6a651957cce415484c01772b50f7976 2023-03-30 16:54:59,534 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da8a9b9c89854bbb8bc629c7e06be988 2023-03-30 16:54:59,534 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/da8a9b9c89854bbb8bc629c7e06be988, entries=3, sequenceid=24, filesize=5.0 K 2023-03-30 16:54:59,535 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/91c3c6a2c80a4337937e078ae5f6ca19 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/91c3c6a2c80a4337937e078ae5f6ca19 2023-03-30 16:54:59,537 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fab7bc4c1162407aa8ff1cc11e2c0eff 2023-03-30 16:54:59,537 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/fab7bc4c1162407aa8ff1cc11e2c0eff, entries=1, sequenceid=24, filesize=5.0 K 2023-03-30 16:54:59,537 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6a651957cce415484c01772b50f7976 2023-03-30 16:54:59,537 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e6a651957cce415484c01772b50f7976, entries=1, sequenceid=24, filesize=5.0 K 2023-03-30 16:54:59,538 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b29fad251876ccdb28c1e80a93ea7325 in 1662ms, sequenceid=24, compaction requested=true 2023-03-30 16:54:59,538 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 80c0ffabf06d7dad81c5f34fac612af6 in 1662ms, sequenceid=24, compaction requested=true 2023-03-30 16:54:59,538 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:54:59,538 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:54:59,538 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:54:59,538 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:59,538 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:54:59,538 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:54:59,538 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91c3c6a2c80a4337937e078ae5f6ca19 2023-03-30 16:54:59,539 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/91c3c6a2c80a4337937e078ae5f6ca19, entries=1, sequenceid=24, filesize=5.0 K 2023-03-30 16:54:59,539 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fadbe83bb5f1f6bef301518ccc05dca3 in 1663ms, sequenceid=24, compaction requested=true 2023-03-30 16:54:59,539 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:54:59,539 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:54:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:54:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:54:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-30 16:54:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-30 16:54:59,541 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:59,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:59,541 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:54:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:59,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-30 16:54:59,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@479cd9bb[Count = 0] remaining members to acquire global barrier 2023-03-30 16:54:59,542 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-30 16:54:59,542 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,548 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-30 16:54:59,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-30 16:54:59,548 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,548 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:54:59,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:54:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-30 16:54:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:59,549 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-30 16:54:59,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:59,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:59,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:59,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:59,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:54:59,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-30 16:54:59,552 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-30 16:54:59,552 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:54:59,552 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:54:59,552 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-30 16:54:59,552 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:54:59,553 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:59,553 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:54:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:54:59,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:59,553 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:54:59,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:59,554 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:54:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:59,555 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:54:59,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-30 16:54:59,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:59,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-30 16:54:59,557 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:54:59,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-30 16:54:59,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:54:59,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-30 16:54:59,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:54:59,557 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:54:59,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:54:59,558 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:54:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:54:59,558 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,558 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-30 16:54:59,558 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-30 16:54:59,558 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-30 16:54:59,558 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:54:59,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:54:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:54:59,658 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:54:59,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:54:59,660 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:54:59,660 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 80c0ffabf06d7dad81c5f34fac612af6/family1 is initiating major compaction (all files) 2023-03-30 16:54:59,660 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:54:59,660 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:54:59,661 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 80c0ffabf06d7dad81c5f34fac612af6/family1 in testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:54:59,661 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/a597d7f611ea4991a9bd1848a185efa8] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp, totalSize=26.7 K 2023-03-30 16:54:59,661 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting b998173087ec48779c5edea886d3e46c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290051 2023-03-30 16:54:59,662 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 4361876fef7d4de18308a6c1a4058898, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:54:59,662 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d3574393c7ea457bbe327b83f1099447, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:54:59,662 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 08a97a760b30471d8c4211df06c9e751, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:54:59,663 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting a597d7f611ea4991a9bd1848a185efa8, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-30 16:54:59,674 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 80c0ffabf06d7dad81c5f34fac612af6#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:00,081 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230330e512a821637f43338bd43630a11c5c08_del 2023-03-30 16:55:00,081 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330e512a821637f43338bd43630a11c5c08_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330e512a821637f43338bd43630a11c5c08_del 2023-03-30 16:55:00,894 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a5b6625a38b4326b962fef2111a0430 2023-03-30 16:55:00,895 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/4a5b6625a38b4326b962fef2111a0430 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4a5b6625a38b4326b962fef2111a0430 2023-03-30 16:55:00,898 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a5b6625a38b4326b962fef2111a0430 2023-03-30 16:55:00,899 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80c0ffabf06d7dad81c5f34fac612af6/family1 of 80c0ffabf06d7dad81c5f34fac612af6 into 4a5b6625a38b4326b962fef2111a0430(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:00,899 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:00,899 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:00,899 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 80c0ffabf06d7dad81c5f34fac612af6/family2 is initiating major compaction (all files) 2023-03-30 16:55:00,899 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:00,899 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:00,900 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 80c0ffabf06d7dad81c5f34fac612af6/family2 in testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:00,900 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e6a651957cce415484c01772b50f7976] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp, totalSize=25.4 K 2023-03-30 16:55:00,900 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 3fb881c8bc334617895ab7d9c73d5476, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290051 2023-03-30 16:55:00,901 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 69176da70273463d95453168043d8aed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:55:00,901 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting de9c8e67d0d44f7b9202a2c29a4dcb6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:00,901 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 5a5823e4e3754e33865bde221fd7f296, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:55:00,901 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting e6a651957cce415484c01772b50f7976, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-30 16:55:00,911 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 80c0ffabf06d7dad81c5f34fac612af6#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:00,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/a597d7f611ea4991a9bd1848a185efa8] to archive 2023-03-30 16:55:00,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:00,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/b998173087ec48779c5edea886d3e46c 2023-03-30 16:55:00,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4361876fef7d4de18308a6c1a4058898 2023-03-30 16:55:00,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/d3574393c7ea457bbe327b83f1099447 2023-03-30 16:55:00,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/08a97a760b30471d8c4211df06c9e751 2023-03-30 16:55:00,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/a597d7f611ea4991a9bd1848a185efa8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/a597d7f611ea4991a9bd1848a185efa8 2023-03-30 16:55:01,319 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023033019ae1864864d4788b7c40bae7708331d_del 2023-03-30 16:55:01,319 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033019ae1864864d4788b7c40bae7708331d_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033019ae1864864d4788b7c40bae7708331d_del 2023-03-30 16:55:02,138 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3adb7269c9d4ca58e8eabadf8d217f0 2023-03-30 16:55:02,138 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/e3adb7269c9d4ca58e8eabadf8d217f0 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e3adb7269c9d4ca58e8eabadf8d217f0 2023-03-30 16:55:02,143 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3adb7269c9d4ca58e8eabadf8d217f0 2023-03-30 16:55:02,144 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80c0ffabf06d7dad81c5f34fac612af6/family2 of 80c0ffabf06d7dad81c5f34fac612af6 into e3adb7269c9d4ca58e8eabadf8d217f0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:02,144 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:02,144 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:02,144 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): fadbe83bb5f1f6bef301518ccc05dca3/family1 is initiating major compaction (all files) 2023-03-30 16:55:02,144 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:02,144 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:02,145 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of fadbe83bb5f1f6bef301518ccc05dca3/family1 in testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:02,145 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/da8a9b9c89854bbb8bc629c7e06be988] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp, totalSize=26.7 K 2023-03-30 16:55:02,146 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting e1ecf56a9bf7486593b3a778f4568014, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290050 2023-03-30 16:55:02,146 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 32fea8bf809d45dda6acde20dc39e115, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:55:02,146 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 2416e084ca9b4a9085ea7fde70748dfa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:02,147 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 01b7deccdc3f4609b8f89bcbcbb9b1ee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:55:02,147 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting da8a9b9c89854bbb8bc629c7e06be988, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-30 16:55:02,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e6a651957cce415484c01772b50f7976] to archive 2023-03-30 16:55:02,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:02,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/3fb881c8bc334617895ab7d9c73d5476 2023-03-30 16:55:02,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/69176da70273463d95453168043d8aed 2023-03-30 16:55:02,157 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): fadbe83bb5f1f6bef301518ccc05dca3#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:02,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/de9c8e67d0d44f7b9202a2c29a4dcb6f 2023-03-30 16:55:02,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/5a5823e4e3754e33865bde221fd7f296 2023-03-30 16:55:02,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e6a651957cce415484c01772b50f7976 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e6a651957cce415484c01772b50f7976 2023-03-30 16:55:02,565 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023033046faff77596646f6a8a9c4c6898889a3_del 2023-03-30 16:55:02,565 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033046faff77596646f6a8a9c4c6898889a3_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033046faff77596646f6a8a9c4c6898889a3_del 2023-03-30 16:55:03,378 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5458e2d4596d4a8890de8ae7995e9033 2023-03-30 16:55:03,379 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/5458e2d4596d4a8890de8ae7995e9033 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5458e2d4596d4a8890de8ae7995e9033 2023-03-30 16:55:03,383 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5458e2d4596d4a8890de8ae7995e9033 2023-03-30 16:55:03,384 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fadbe83bb5f1f6bef301518ccc05dca3/family1 of fadbe83bb5f1f6bef301518ccc05dca3 into 5458e2d4596d4a8890de8ae7995e9033(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:03,384 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:03,384 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:03,384 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): fadbe83bb5f1f6bef301518ccc05dca3/family2 is initiating major compaction (all files) 2023-03-30 16:55:03,385 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:03,385 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:03,386 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of fadbe83bb5f1f6bef301518ccc05dca3/family2 in testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:03,386 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/91c3c6a2c80a4337937e078ae5f6ca19] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp, totalSize=25.4 K 2023-03-30 16:55:03,386 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting c5edef28457646a8be5e2fb7168ec592, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290050 2023-03-30 16:55:03,387 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 2a01493e7d074b0a8e262d90492ba9e3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:55:03,387 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 1e672f4517804adc98af82b6a72d68c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:03,387 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 64aa8daea9b84bdb88e24bd759e29f59, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:55:03,388 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 91c3c6a2c80a4337937e078ae5f6ca19, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-30 16:55:03,398 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): fadbe83bb5f1f6bef301518ccc05dca3#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:03,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/da8a9b9c89854bbb8bc629c7e06be988] to archive 2023-03-30 16:55:03,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:03,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/e1ecf56a9bf7486593b3a778f4568014 2023-03-30 16:55:03,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/32fea8bf809d45dda6acde20dc39e115 2023-03-30 16:55:03,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/2416e084ca9b4a9085ea7fde70748dfa 2023-03-30 16:55:03,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/01b7deccdc3f4609b8f89bcbcbb9b1ee 2023-03-30 16:55:03,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/da8a9b9c89854bbb8bc629c7e06be988 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/da8a9b9c89854bbb8bc629c7e06be988 2023-03-30 16:55:03,805 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230330c17dbef25be44108a871a9dc55d46dd5_del 2023-03-30 16:55:03,805 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330c17dbef25be44108a871a9dc55d46dd5_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330c17dbef25be44108a871a9dc55d46dd5_del 2023-03-30 16:55:04,619 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18773b1f53ad4a849aaf2df7cf7ec906 2023-03-30 16:55:04,620 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/18773b1f53ad4a849aaf2df7cf7ec906 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/18773b1f53ad4a849aaf2df7cf7ec906 2023-03-30 16:55:04,624 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18773b1f53ad4a849aaf2df7cf7ec906 2023-03-30 16:55:04,625 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fadbe83bb5f1f6bef301518ccc05dca3/family2 of fadbe83bb5f1f6bef301518ccc05dca3 into 18773b1f53ad4a849aaf2df7cf7ec906(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:04,625 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:04,625 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:04,625 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): b29fad251876ccdb28c1e80a93ea7325/family1 is initiating major compaction (all files) 2023-03-30 16:55:04,625 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:04,625 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:04,625 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of b29fad251876ccdb28c1e80a93ea7325/family1 in testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:04,625 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3cf960c53eda4080ae35b3c95d0a027a] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp, totalSize=26.7 K 2023-03-30 16:55:04,626 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 091aa93aed084f5cadfe48960fd07f31, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290048 2023-03-30 16:55:04,626 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 1588d3d561964f8fb1984959c783dc2e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291177 2023-03-30 16:55:04,626 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting ca6332d0876048a18f6b383e8d554f52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:04,627 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 3fea413fcc6f43bfa48d5e9628ba6a8e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293683 2023-03-30 16:55:04,627 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 3cf960c53eda4080ae35b3c95d0a027a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-30 16:55:04,637 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): b29fad251876ccdb28c1e80a93ea7325#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:04,645 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303303f3a9e2016da496983944fe677588f2e_del 2023-03-30 16:55:04,645 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303303f3a9e2016da496983944fe677588f2e_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303303f3a9e2016da496983944fe677588f2e_del 2023-03-30 16:55:04,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/91c3c6a2c80a4337937e078ae5f6ca19] to archive 2023-03-30 16:55:04,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:04,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/c5edef28457646a8be5e2fb7168ec592 2023-03-30 16:55:04,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/2a01493e7d074b0a8e262d90492ba9e3 2023-03-30 16:55:04,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/1e672f4517804adc98af82b6a72d68c4 2023-03-30 16:55:04,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/64aa8daea9b84bdb88e24bd759e29f59 2023-03-30 16:55:04,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/91c3c6a2c80a4337937e078ae5f6ca19 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/91c3c6a2c80a4337937e078ae5f6ca19 2023-03-30 16:55:04,663 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 035b901adb334dfea3466cdc01d698ed 2023-03-30 16:55:04,663 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/035b901adb334dfea3466cdc01d698ed as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/035b901adb334dfea3466cdc01d698ed 2023-03-30 16:55:04,667 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 035b901adb334dfea3466cdc01d698ed 2023-03-30 16:55:04,668 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b29fad251876ccdb28c1e80a93ea7325/family1 of b29fad251876ccdb28c1e80a93ea7325 into 035b901adb334dfea3466cdc01d698ed(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:04,668 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:04,668 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:04,668 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): b29fad251876ccdb28c1e80a93ea7325/family2 is initiating major compaction (all files) 2023-03-30 16:55:04,668 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:04,668 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:04,669 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of b29fad251876ccdb28c1e80a93ea7325/family2 in testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:04,669 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/fab7bc4c1162407aa8ff1cc11e2c0eff] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp, totalSize=25.4 K 2023-03-30 16:55:04,670 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting c9d7402570734810ba9dcd4014768215, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290048 2023-03-30 16:55:04,670 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 58bbbd976dbb48b086469c4589270ab3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291177 2023-03-30 16:55:04,670 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting f94fbf93d5934e278bbb9055d5d09de1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:04,671 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 271513167c8342c5999637e89a2323f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293683 2023-03-30 16:55:04,671 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting fab7bc4c1162407aa8ff1cc11e2c0eff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-30 16:55:04,682 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): b29fad251876ccdb28c1e80a93ea7325#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:04,690 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230330f05cc665b6144c22a91333ff7af18787_del 2023-03-30 16:55:04,690 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330f05cc665b6144c22a91333ff7af18787_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330f05cc665b6144c22a91333ff7af18787_del 2023-03-30 16:55:04,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3cf960c53eda4080ae35b3c95d0a027a] to archive 2023-03-30 16:55:04,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:04,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/091aa93aed084f5cadfe48960fd07f31 2023-03-30 16:55:04,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/1588d3d561964f8fb1984959c783dc2e 2023-03-30 16:55:04,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ca6332d0876048a18f6b383e8d554f52 2023-03-30 16:55:04,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3fea413fcc6f43bfa48d5e9628ba6a8e 2023-03-30 16:55:04,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3cf960c53eda4080ae35b3c95d0a027a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/3cf960c53eda4080ae35b3c95d0a027a 2023-03-30 16:55:05,504 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19d028606b41493b801b6426a21a915f 2023-03-30 16:55:05,505 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/19d028606b41493b801b6426a21a915f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/19d028606b41493b801b6426a21a915f 2023-03-30 16:55:05,509 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19d028606b41493b801b6426a21a915f 2023-03-30 16:55:05,510 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b29fad251876ccdb28c1e80a93ea7325/family2 of b29fad251876ccdb28c1e80a93ea7325 into 19d028606b41493b801b6426a21a915f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:05,510 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:05,517 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:05,528 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:05,540 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:05,541 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:05,552 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-30 16:55:05,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/fab7bc4c1162407aa8ff1cc11e2c0eff] to archive 2023-03-30 16:55:05,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:05,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/c9d7402570734810ba9dcd4014768215 2023-03-30 16:55:05,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/58bbbd976dbb48b086469c4589270ab3 2023-03-30 16:55:05,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/f94fbf93d5934e278bbb9055d5d09de1 2023-03-30 16:55:05,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/271513167c8342c5999637e89a2323f3 2023-03-30 16:55:05,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/fab7bc4c1162407aa8ff1cc11e2c0eff to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/fab7bc4c1162407aa8ff1cc11e2c0eff 2023-03-30 16:55:05,618 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-30 16:55:05,623 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303303f3a9e2016da496983944fe677588f2e_del 2023-03-30 16:55:05,628 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023033046faff77596646f6a8a9c4c6898889a3_del 2023-03-30 16:55:05,631 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230330e512a821637f43338bd43630a11c5c08_del 2023-03-30 16:55:05,631 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:05,631 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(139): Connect 0x07305cf5 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:55:05,642 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4adbf221, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:55:05,642 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:05,642 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:05,643 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:06,252 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303302202e64e97bb468182229d02bac35f80 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303302202e64e97bb468182229d02bac35f80 2023-03-30 16:55:06,255 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:06,259 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330eb5e4b70e9464a38a2b9bf0d548686d3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330eb5e4b70e9464a38a2b9bf0d548686d3 2023-03-30 16:55:06,260 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:06,279 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:55:06,285 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39124, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:55:06,295 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:55:06,298 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54824, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:55:06,327 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/75e7096a0e834d82b2553a79864425b9 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-30 16:55:06,327 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/75e7096a0e834d82b2553a79864425b9}] 2023-03-30 16:55:06,328 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/83a21517ed8b480e8fa1206b81a18e2b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-30 16:55:06,337 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/83a21517ed8b480e8fa1206b81a18e2b}] 2023-03-30 16:55:06,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/75e7096a0e834d82b2553a79864425b9 for inclusion in b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:55:06,340 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/83a21517ed8b480e8fa1206b81a18e2b for inclusion in fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:55:06,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-30 16:55:06,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last=1 2023-03-30 16:55:06,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:06,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/75e7096a0e834d82b2553a79864425b9 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__evp52c3e5qfulcvula3g5fdhef8sa7tmv657jk46931pd7kcpsq5hd52alk3nn1a/family1/75e7096a0e834d82b2553a79864425b9 2023-03-30 16:55:06,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-30 16:55:06,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-30 16:55:06,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/83a21517ed8b480e8fa1206b81a18e2b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__jdqltg79kkrok79jaeilch5gl8brf3ng36okp0i6jdoe6uek68a0br3ttkml6i7/family1/83a21517ed8b480e8fa1206b81a18e2b 2023-03-30 16:55:06,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__evp52c3e5qfulcvula3g5fdhef8sa7tmv657jk46931pd7kcpsq5hd52alk3nn1a/family1/75e7096a0e834d82b2553a79864425b9 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_ 2023-03-30 16:55:06,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__evp52c3e5qfulcvula3g5fdhef8sa7tmv657jk46931pd7kcpsq5hd52alk3nn1a/family1/75e7096a0e834d82b2553a79864425b9 into b29fad251876ccdb28c1e80a93ea7325/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_ - updating store file list. 2023-03-30 16:55:06,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__jdqltg79kkrok79jaeilch5gl8brf3ng36okp0i6jdoe6uek68a0br3ttkml6i7/family1/83a21517ed8b480e8fa1206b81a18e2b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_ 2023-03-30 16:55:06,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_ into b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:55:06,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__evp52c3e5qfulcvula3g5fdhef8sa7tmv657jk46931pd7kcpsq5hd52alk3nn1a/family1/75e7096a0e834d82b2553a79864425b9 into b29fad251876ccdb28c1e80a93ea7325/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_) 2023-03-30 16:55:06,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__evp52c3e5qfulcvula3g5fdhef8sa7tmv657jk46931pd7kcpsq5hd52alk3nn1a/family1/75e7096a0e834d82b2553a79864425b9 2023-03-30 16:55:06,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__jdqltg79kkrok79jaeilch5gl8brf3ng36okp0i6jdoe6uek68a0br3ttkml6i7/family1/83a21517ed8b480e8fa1206b81a18e2b into fadbe83bb5f1f6bef301518ccc05dca3/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_ - updating store file list. 2023-03-30 16:55:06,358 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:06,359 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:06,361 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a 2023-03-30 16:55:06,362 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 2023-03-30 16:55:06,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_ into fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:55:06,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__jdqltg79kkrok79jaeilch5gl8brf3ng36okp0i6jdoe6uek68a0br3ttkml6i7/family1/83a21517ed8b480e8fa1206b81a18e2b into fadbe83bb5f1f6bef301518ccc05dca3/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_) 2023-03-30 16:55:06,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__jdqltg79kkrok79jaeilch5gl8brf3ng36okp0i6jdoe6uek68a0br3ttkml6i7/family1/83a21517ed8b480e8fa1206b81a18e2b 2023-03-30 16:55:06,364 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 2023-03-30 16:55:06,365 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 2023-03-30 16:55:06,365 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-30 16:55:06,365 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330' 2023-03-30 16:55:06,365 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:06,365 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:06,366 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:06,367 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d 2023-03-30 16:55:06,368 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad 2023-03-30 16:55:06,369 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e 2023-03-30 16:55:06,370 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 2023-03-30 16:55:06,370 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-30 16:55:06,370 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330' 2023-03-30 16:55:06,372 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:06,638 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303307a565ac82f9d4c85acee8ee2ee37b472 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303307a565ac82f9d4c85acee8ee2ee37b472 2023-03-30 16:55:06,639 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:06,671 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/da55a4a61c3d47c6903400363fe7b3fd first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-30 16:55:06,672 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/da55a4a61c3d47c6903400363fe7b3fd}] 2023-03-30 16:55:06,675 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/da55a4a61c3d47c6903400363fe7b3fd for inclusion in 80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:55:06,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-30 16:55:06,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-30 16:55:06,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:06,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/da55a4a61c3d47c6903400363fe7b3fd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__48bts3vthr32rm1bqtlnt3hhtit4dmih549shha5rmqh4r67nih9phnh09c8pboa/family1/da55a4a61c3d47c6903400363fe7b3fd 2023-03-30 16:55:06,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__48bts3vthr32rm1bqtlnt3hhtit4dmih549shha5rmqh4r67nih9phnh09c8pboa/family1/da55a4a61c3d47c6903400363fe7b3fd as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_ 2023-03-30 16:55:06,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__48bts3vthr32rm1bqtlnt3hhtit4dmih549shha5rmqh4r67nih9phnh09c8pboa/family1/da55a4a61c3d47c6903400363fe7b3fd into 80c0ffabf06d7dad81c5f34fac612af6/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_ - updating store file list. 2023-03-30 16:55:06,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_ into 80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:55:06,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__48bts3vthr32rm1bqtlnt3hhtit4dmih549shha5rmqh4r67nih9phnh09c8pboa/family1/da55a4a61c3d47c6903400363fe7b3fd into 80c0ffabf06d7dad81c5f34fac612af6/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_) 2023-03-30 16:55:06,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__48bts3vthr32rm1bqtlnt3hhtit4dmih549shha5rmqh4r67nih9phnh09c8pboa/family1/da55a4a61c3d47c6903400363fe7b3fd 2023-03-30 16:55:06,691 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:06,692 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:06,694 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 2023-03-30 16:55:06,696 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 2023-03-30 16:55:06,697 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff 2023-03-30 16:55:06,698 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 2023-03-30 16:55:06,698 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-30 16:55:06,698 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330' 2023-03-30 16:55:06,699 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:06,699 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:06,699 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:06,699 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303303f3a9e2016da496983944fe677588f2e_del] 2023-03-30 16:55:06,700 DEBUG [Listener at localhost/41799] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:06,701 DEBUG [Listener at localhost/41799] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303303f3a9e2016da496983944fe677588f2e_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303303f3a9e2016da496983944fe677588f2e_del 2023-03-30 16:55:06,701 INFO [Listener at localhost/41799] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-30 16:55:06,701 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033046faff77596646f6a8a9c4c6898889a3_del] 2023-03-30 16:55:06,702 DEBUG [Listener at localhost/41799] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:06,703 DEBUG [Listener at localhost/41799] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033046faff77596646f6a8a9c4c6898889a3_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033046faff77596646f6a8a9c4c6898889a3_del 2023-03-30 16:55:06,703 INFO [Listener at localhost/41799] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-30 16:55:06,704 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330e512a821637f43338bd43630a11c5c08_del] 2023-03-30 16:55:06,704 DEBUG [Listener at localhost/41799] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:06,706 DEBUG [Listener at localhost/41799] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330e512a821637f43338bd43630a11c5c08_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330e512a821637f43338bd43630a11c5c08_del 2023-03-30 16:55:06,706 INFO [Listener at localhost/41799] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-30 16:55:06,710 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:06,716 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:06,721 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:06,722 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:06,731 INFO [Listener at localhost/41799] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-30 16:55:06,731 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-03-30 16:55:06,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-30 16:55:06,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-30 16:55:06,735 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195306735"}]},"ts":"1680195306735"} 2023-03-30 16:55:06,737 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-30 16:55:06,739 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-30 16:55:06,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, UNASSIGN}] 2023-03-30 16:55:06,741 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, UNASSIGN 2023-03-30 16:55:06,742 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=b29fad251876ccdb28c1e80a93ea7325, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:06,742 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195306742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195306742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195306742"}]},"ts":"1680195306742"} 2023-03-30 16:55:06,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure b29fad251876ccdb28c1e80a93ea7325, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:06,750 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, UNASSIGN 2023-03-30 16:55:06,750 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, UNASSIGN 2023-03-30 16:55:06,751 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=80c0ffabf06d7dad81c5f34fac612af6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:06,751 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=fadbe83bb5f1f6bef301518ccc05dca3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:06,752 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195306751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195306751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195306751"}]},"ts":"1680195306751"} 2023-03-30 16:55:06,752 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195306751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195306751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195306751"}]},"ts":"1680195306751"} 2023-03-30 16:55:06,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure fadbe83bb5f1f6bef301518ccc05dca3, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:06,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 80c0ffabf06d7dad81c5f34fac612af6, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:06,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-30 16:55:06,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:06,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b29fad251876ccdb28c1e80a93ea7325, disabling compactions & flushes 2023-03-30 16:55:06,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:06,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:06,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. after waiting 0 ms 2023-03-30 16:55:06,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-30 16:55:06,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:06,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:06,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:06,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:06,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80c0ffabf06d7dad81c5f34fac612af6, disabling compactions & flushes 2023-03-30 16:55:06,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:06,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:06,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. after waiting 0 ms 2023-03-30 16:55:06,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:06,909 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=b29fad251876ccdb28c1e80a93ea7325, regionState=CLOSED 2023-03-30 16:55:06,909 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195306909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195306909"}]},"ts":"1680195306909"} 2023-03-30 16:55:06,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=89 2023-03-30 16:55:06,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure b29fad251876ccdb28c1e80a93ea7325, server=jenkins-hbase4.apache.org,39029,1680195214375 in 168 msec 2023-03-30 16:55:06,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, UNASSIGN in 173 msec 2023-03-30 16:55:06,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-30 16:55:06,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:06,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:06,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:06,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:06,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fadbe83bb5f1f6bef301518ccc05dca3, disabling compactions & flushes 2023-03-30 16:55:06,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:06,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=80c0ffabf06d7dad81c5f34fac612af6, regionState=CLOSED 2023-03-30 16:55:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. after waiting 0 ms 2023-03-30 16:55:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:06,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195306922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195306922"}]},"ts":"1680195306922"} 2023-03-30 16:55:06,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-03-30 16:55:06,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 80c0ffabf06d7dad81c5f34fac612af6, server=jenkins-hbase4.apache.org,39029,1680195214375 in 167 msec 2023-03-30 16:55:06,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, UNASSIGN in 185 msec 2023-03-30 16:55:06,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-30 16:55:06,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:06,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:06,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:06,938 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=fadbe83bb5f1f6bef301518ccc05dca3, regionState=CLOSED 2023-03-30 16:55:06,938 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195306938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195306938"}]},"ts":"1680195306938"} 2023-03-30 16:55:06,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-03-30 16:55:06,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure fadbe83bb5f1f6bef301518ccc05dca3, server=jenkins-hbase4.apache.org,39029,1680195214375 in 183 msec 2023-03-30 16:55:06,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-03-30 16:55:06,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, UNASSIGN in 201 msec 2023-03-30 16:55:06,942 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195306942"}]},"ts":"1680195306942"} 2023-03-30 16:55:06,944 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-30 16:55:06,945 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-30 16:55:06,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 215 msec 2023-03-30 16:55:07,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-30 16:55:07,038 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-30 16:55:07,050 INFO [Listener at localhost/41799] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:07,051 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-30 16:55:07,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1680195307051 (current time:1680195307051). 2023-03-30 16:55:07,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-30 16:55:07,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] zookeeper.ReadOnlyZKClient(139): Connect 0x060f6e2d to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:55:07,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b432ce1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:55:07,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:55:07,061 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39136, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:55:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x060f6e2d to 127.0.0.1:64100 2023-03-30 16:55:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-30 16:55:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-30 16:55:07,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-30 16:55:07,066 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-30 16:55:07,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-30 16:55:07,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1680195295679-1680195307050 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-30 16:55:07,067 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1680195907067 2023-03-30 16:55:07,067 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:07,067 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-30 16:55:07,168 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:55:07,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:55:07,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:55:07,169 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-30 16:55:07,369 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:55:07,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:55:07,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:55:07,371 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-30 16:55:07,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-30 16:55:07,475 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-30 16:55:07,475 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-30 16:55:07,475 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-30 16:55:07,475 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-30 16:55:07,475 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-30 16:55:07,475 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-30 16:55:07,476 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-30 16:55:07,476 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330eb5e4b70e9464a38a2b9bf0d548686d3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303307a565ac82f9d4c85acee8ee2ee37b472, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303302202e64e97bb468182229d02bac35f80] hfiles 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5458e2d4596d4a8890de8ae7995e9033, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_] hfiles 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4a5b6625a38b4326b962fef2111a0430, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_] hfiles 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330eb5e4b70e9464a38a2b9bf0d548686d3 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4a5b6625a38b4326b962fef2111a0430 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/035b901adb334dfea3466cdc01d698ed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_] hfiles 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5458e2d4596d4a8890de8ae7995e9033 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/035b901adb334dfea3466cdc01d698ed 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_ 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_ 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303307a565ac82f9d4c85acee8ee2ee37b472 2023-03-30 16:55:07,479 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_ 2023-03-30 16:55:07,480 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303302202e64e97bb468182229d02bac35f80 2023-03-30 16:55:07,480 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/18773b1f53ad4a849aaf2df7cf7ec906] hfiles 2023-03-30 16:55:07,480 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/19d028606b41493b801b6426a21a915f] hfiles 2023-03-30 16:55:07,481 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/18773b1f53ad4a849aaf2df7cf7ec906 2023-03-30 16:55:07,481 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e3adb7269c9d4ca58e8eabadf8d217f0] hfiles 2023-03-30 16:55:07,481 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/19d028606b41493b801b6426a21a915f 2023-03-30 16:55:07,481 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e3adb7269c9d4ca58e8eabadf8d217f0 2023-03-30 16:55:07,490 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303308c80ae6d1a7e453f98c417e57b556f13, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033098d5bb92cbba4d4997aef88e0b82dc7a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330c17dbef25be44108a871a9dc55d46dd5_del, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330d95136a09f1c48ca954e50dd5c8a2062, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330ffc2d363c76c4c94b2c100c3ed8d1f50, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033019ae1864864d4788b7c40bae7708331d_del, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303301ba4f06940294e04b51c4422aa945edb, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303302ad1550b092d4583ac4b04b42ee93e67, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303305235f78374d24ac6a9c9237416c30f49, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230330835369fef7d24e47a888bf55d11dac08, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330262847b1206d4e5eab9a1cd75a27fd76, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033035d255f55fd942b68c43910752c983c2, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303305e461d4512a4405894a810331f347f23, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033085c3c7b4b50f445aa008c0dd5569ec70, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330f05cc665b6144c22a91333ff7af18787_del] hfiles 2023-03-30 16:55:07,490 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303308c80ae6d1a7e453f98c417e57b556f13 2023-03-30 16:55:07,490 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033098d5bb92cbba4d4997aef88e0b82dc7a 2023-03-30 16:55:07,490 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330c17dbef25be44108a871a9dc55d46dd5_del 2023-03-30 16:55:07,490 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330d95136a09f1c48ca954e50dd5c8a2062 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330ffc2d363c76c4c94b2c100c3ed8d1f50 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033019ae1864864d4788b7c40bae7708331d_del 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303301ba4f06940294e04b51c4422aa945edb 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303302ad1550b092d4583ac4b04b42ee93e67 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303305235f78374d24ac6a9c9237416c30f49 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230330835369fef7d24e47a888bf55d11dac08 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330262847b1206d4e5eab9a1cd75a27fd76 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033035d255f55fd942b68c43910752c983c2 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303305e461d4512a4405894a810331f347f23 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033085c3c7b4b50f445aa008c0dd5569ec70 2023-03-30 16:55:07,491 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330f05cc665b6144c22a91333ff7af18787_del 2023-03-30 16:55:07,671 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:55:07,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:55:07,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:55:07,672 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-30 16:55:07,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-30 16:55:07,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:07,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:08,172 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:55:08,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:55:08,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:55:08,173 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-30 16:55:08,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680195295679-1680195307050 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:09,174 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:55:09,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:55:09,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-30 16:55:09,175 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-03-30 16:55:09,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1680195295679-1680195307050 of table testCompactionWithHFileLink completed 2023-03-30 16:55:09,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:09,202 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:09,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1680195295679-1680195307050 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1680195307067Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1680195307474 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1680195295679-1680195307050 at 1680195307924 (+450 ms)Loading Region manifests for hbase-failsafe-snaptb-1680195295679-1680195307050 at 1680195307924Writing data manifest for hbase-failsafe-snaptb-1680195295679-1680195307050 at 1680195307932 (+8 ms)Verifying snapshot: hbase-failsafe-snaptb-1680195295679-1680195307050 at 1680195308347 (+415 ms)Snapshot hbase-failsafe-snaptb-1680195295679-1680195307050 of table testCompactionWithHFileLink completed at 1680195309202 (+855 ms) 2023-03-30 16:55:09,204 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-30 16:55:09,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.1390 sec 2023-03-30 16:55:11,175 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-30 16:55:11,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-30 16:55:11,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1680195295679-1680195307050 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-30 16:55:11,443 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:55:11,443 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07305cf5 to 127.0.0.1:64100 2023-03-30 16:55:11,443 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:11,443 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-30 16:55:11,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1680195295679" table: "testCompactionWithHFileLink" creation_time: 1680195295693 type: FLUSH version: 2 ttl: 0 ) 2023-03-30 16:55:11,453 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1680195295679 as table=testCompactionWithHFileLink 2023-03-30 16:55:11,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-30 16:55:11,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-30 16:55:11,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-30 16:55:11,867 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-30 16:55:11,868 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-30 16:55:11,868 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-30 16:55:11,869 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-30 16:55:11,873 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1680195295679" table: "testCompactionWithHFileLink" creation_time: 1680195295693 type: FLUSH version: 2 ttl: 0 2023-03-30 16:55:11,874 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink 2023-03-30 16:55:11,879 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-30 16:55:11,883 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303307a565ac82f9d4c85acee8ee2ee37b472 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303307a565ac82f9d4c85acee8ee2ee37b472 2023-03-30 16:55:11,884 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303302202e64e97bb468182229d02bac35f80 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303302202e64e97bb468182229d02bac35f80 2023-03-30 16:55:11,886 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330eb5e4b70e9464a38a2b9bf0d548686d3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230330eb5e4b70e9464a38a2b9bf0d548686d3 2023-03-30 16:55:11,886 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,905 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,919 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,922 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,926 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,929 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,934 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,950 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,962 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,966 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,991 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:11,997 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 of snapshot=snaptb-1680195295679 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-30 16:55:12,004 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033019ae1864864d4788b7c40bae7708331d_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033019ae1864864d4788b7c40bae7708331d_del 2023-03-30 16:55:12,005 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330c17dbef25be44108a871a9dc55d46dd5_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230330c17dbef25be44108a871a9dc55d46dd5_del 2023-03-30 16:55:12,006 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330f05cc665b6144c22a91333ff7af18787_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230330f05cc665b6144c22a91333ff7af18787_del 2023-03-30 16:55:12,006 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:12,006 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:12,006 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,010 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/035b901adb334dfea3466cdc01d698ed to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/035b901adb334dfea3466cdc01d698ed 2023-03-30 16:55:12,012 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4a5b6625a38b4326b962fef2111a0430 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/4a5b6625a38b4326b962fef2111a0430 2023-03-30 16:55:12,012 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5f5cb7cf31884fab979287a1d6361d9c_SeqId_29_ 2023-03-30 16:55:12,013 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/0593bdf8d40c4cbf98e8d8ba35d18b07_SeqId_29_ 2023-03-30 16:55:12,013 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 091aa93aed084f5cadfe48960fd07f31 of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,014 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/869508db34244547aeff9ab71f174eb5_SeqId_29_ 2023-03-30 16:55:12,014 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b998173087ec48779c5edea886d3e46c of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,014 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5458e2d4596d4a8890de8ae7995e9033 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/5458e2d4596d4a8890de8ae7995e9033 2023-03-30 16:55:12,014 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e1ecf56a9bf7486593b3a778f4568014 of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,020 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4361876fef7d4de18308a6c1a4058898 of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,020 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 32fea8bf809d45dda6acde20dc39e115 of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,023 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1588d3d561964f8fb1984959c783dc2e of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,026 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2416e084ca9b4a9085ea7fde70748dfa of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,026 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d3574393c7ea457bbe327b83f1099447 of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,040 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 01b7deccdc3f4609b8f89bcbcbb9b1ee of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,040 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08a97a760b30471d8c4211df06c9e751 of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,041 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ca6332d0876048a18f6b383e8d554f52 of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,049 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3fea413fcc6f43bfa48d5e9628ba6a8e of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,051 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/18773b1f53ad4a849aaf2df7cf7ec906 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/18773b1f53ad4a849aaf2df7cf7ec906 2023-03-30 16:55:12,051 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c5edef28457646a8be5e2fb7168ec592 of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,054 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e3adb7269c9d4ca58e8eabadf8d217f0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/e3adb7269c9d4ca58e8eabadf8d217f0 2023-03-30 16:55:12,054 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3fb881c8bc334617895ab7d9c73d5476 of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,060 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/19d028606b41493b801b6426a21a915f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/19d028606b41493b801b6426a21a915f 2023-03-30 16:55:12,060 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9d7402570734810ba9dcd4014768215 of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-30 16:55:12,069 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2a01493e7d074b0a8e262d90492ba9e3 of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,074 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 69176da70273463d95453168043d8aed of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,074 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 58bbbd976dbb48b086469c4589270ab3 of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,075 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1e672f4517804adc98af82b6a72d68c4 of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,080 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f94fbf93d5934e278bbb9055d5d09de1 of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,080 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink de9c8e67d0d44f7b9202a2c29a4dcb6f of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,081 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 64aa8daea9b84bdb88e24bd759e29f59 of snapshot=snaptb-1680195295679 to region=fadbe83bb5f1f6bef301518ccc05dca3 table=testCompactionWithHFileLink 2023-03-30 16:55:12,085 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5a5823e4e3754e33865bde221fd7f296 of snapshot=snaptb-1680195295679 to region=80c0ffabf06d7dad81c5f34fac612af6 table=testCompactionWithHFileLink 2023-03-30 16:55:12,085 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 271513167c8342c5999637e89a2323f3 of snapshot=snaptb-1680195295679 to region=b29fad251876ccdb28c1e80a93ea7325 table=testCompactionWithHFileLink 2023-03-30 16:55:12,090 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1680195295679" table: "testCompactionWithHFileLink" creation_time: 1680195295693 type: FLUSH version: 2 ttl: 0 2023-03-30 16:55:12,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680195312091"}]},"ts":"9223372036854775807"} 2023-03-30 16:55:12,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680195312091"}]},"ts":"9223372036854775807"} 2023-03-30 16:55:12,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680195312091"}]},"ts":"9223372036854775807"} 2023-03-30 16:55:12,094 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-30 16:55:12,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 80c0ffabf06d7dad81c5f34fac612af6, NAME => 'testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => b29fad251876ccdb28c1e80a93ea7325, NAME => 'testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fadbe83bb5f1f6bef301518ccc05dca3, NAME => 'testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.', STARTKEY => '1', ENDKEY => '2'}] 2023-03-30 16:55:12,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195312092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195312092"}]},"ts":"1680195312092"} 2023-03-30 16:55:12,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195312092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195312092"}]},"ts":"1680195312092"} 2023-03-30 16:55:12,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195312092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195312092"}]},"ts":"1680195312092"} 2023-03-30 16:55:12,096 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-30 16:55:12,096 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-30 16:55:12,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 80c0ffabf06d7dad81c5f34fac612af6, NAME => 'testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => b29fad251876ccdb28c1e80a93ea7325, NAME => 'testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fadbe83bb5f1f6bef301518ccc05dca3, NAME => 'testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.', STARTKEY => '1', ENDKEY => '2'}] 2023-03-30 16:55:12,097 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1680195295679 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-30 16:55:12,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1680195295679" table: "testCompactionWithHFileLink" creation_time: 1680195295693 type: FLUSH version: 2 ttl: 0 ) in 854 msec 2023-03-30 16:55:12,463 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:55:12,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-30 16:55:12,562 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-30 16:55:12,562 INFO [Listener at localhost/41799] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:12,566 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1680195295679-1680195307050" 2023-03-30 16:55:12,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1680195295679-1680195307050 2023-03-30 16:55:12,571 INFO [Listener at localhost/41799] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-30 16:55:12,576 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-03-30 16:55:12,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-30 16:55:12,586 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-30 16:55:12,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195312586"}]},"ts":"1680195312586"} 2023-03-30 16:55:12,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-30 16:55:12,587 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-30 16:55:12,592 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-30 16:55:12,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN}] 2023-03-30 16:55:12,594 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN 2023-03-30 16:55:12,594 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN 2023-03-30 16:55:12,594 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN 2023-03-30 16:55:12,595 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-30 16:55:12,595 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-30 16:55:12,595 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-30 16:55:12,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-30 16:55:12,746 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=80c0ffabf06d7dad81c5f34fac612af6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:12,746 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=b29fad251876ccdb28c1e80a93ea7325, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:12,746 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195312746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195312746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195312746"}]},"ts":"1680195312746"} 2023-03-30 16:55:12,746 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=fadbe83bb5f1f6bef301518ccc05dca3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:12,747 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195312746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195312746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195312746"}]},"ts":"1680195312746"} 2023-03-30 16:55:12,747 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195312746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195312746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195312746"}]},"ts":"1680195312746"} 2023-03-30 16:55:12,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 80c0ffabf06d7dad81c5f34fac612af6, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:12,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure b29fad251876ccdb28c1e80a93ea7325, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:12,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure fadbe83bb5f1f6bef301518ccc05dca3, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:12,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-30 16:55:12,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:12,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fadbe83bb5f1f6bef301518ccc05dca3, NAME => 'testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.', STARTKEY => '1', ENDKEY => '2'} 2023-03-30 16:55:12,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:12,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,905 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,906 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:55:12,906 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:55:12,906 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fadbe83bb5f1f6bef301518ccc05dca3 columnFamilyName family1 2023-03-30 16:55:12,925 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-01b7deccdc3f4609b8f89bcbcbb9b1ee 2023-03-30 16:55:12,931 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2416e084ca9b4a9085ea7fde70748dfa 2023-03-30 16:55:12,936 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-32fea8bf809d45dda6acde20dc39e115 2023-03-30 16:55:12,942 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-e1ecf56a9bf7486593b3a778f4568014 2023-03-30 16:55:12,942 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(310): Store=fadbe83bb5f1f6bef301518ccc05dca3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:12,942 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,943 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2 2023-03-30 16:55:12,943 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2 2023-03-30 16:55:12,944 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fadbe83bb5f1f6bef301518ccc05dca3 columnFamilyName family2 2023-03-30 16:55:12,964 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-1e672f4517804adc98af82b6a72d68c4 2023-03-30 16:55:12,971 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2a01493e7d074b0a8e262d90492ba9e3 2023-03-30 16:55:12,978 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-64aa8daea9b84bdb88e24bd759e29f59 2023-03-30 16:55:12,994 DEBUG [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-c5edef28457646a8be5e2fb7168ec592 2023-03-30 16:55:12,995 INFO [StoreOpener-fadbe83bb5f1f6bef301518ccc05dca3-1] regionserver.HStore(310): Store=fadbe83bb5f1f6bef301518ccc05dca3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:12,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:12,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:13,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:13,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fadbe83bb5f1f6bef301518ccc05dca3; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72977807, jitterRate=0.08745406568050385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:13,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:13,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3., pid=103, masterSystemTime=1680195312900 2023-03-30 16:55:13,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-30 16:55:13,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-30 16:55:13,011 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-30 16:55:13,011 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-30 16:55:13,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:13,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:13,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:13,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b29fad251876ccdb28c1e80a93ea7325, NAME => 'testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.', STARTKEY => '', ENDKEY => '1'} 2023-03-30 16:55:13,013 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=fadbe83bb5f1f6bef301518ccc05dca3, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:13,013 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195313013"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195313013"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195313013"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195313013"}]},"ts":"1680195313013"} 2023-03-30 16:55:13,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:13,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-03-30 16:55:13,016 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-30 16:55:13,016 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1912): fadbe83bb5f1f6bef301518ccc05dca3/family1 is initiating minor compaction (all files) 2023-03-30 16:55:13,017 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2259): Starting compaction of fadbe83bb5f1f6bef301518ccc05dca3/family1 in testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:13,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure fadbe83bb5f1f6bef301518ccc05dca3, server=jenkins-hbase4.apache.org,39029,1680195214375 in 266 msec 2023-03-30 16:55:13,017 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-e1ecf56a9bf7486593b3a778f4568014, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-32fea8bf809d45dda6acde20dc39e115, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2416e084ca9b4a9085ea7fde70748dfa, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-01b7deccdc3f4609b8f89bcbcbb9b1ee] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp, totalSize=21.6 K 2023-03-30 16:55:13,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fadbe83bb5f1f6bef301518ccc05dca3, ASSIGN in 424 msec 2023-03-30 16:55:13,019 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-e1ecf56a9bf7486593b3a778f4568014, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290050 2023-03-30 16:55:13,019 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-30 16:55:13,019 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1912): fadbe83bb5f1f6bef301518ccc05dca3/family2 is initiating minor compaction (all files) 2023-03-30 16:55:13,019 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fadbe83bb5f1f6bef301518ccc05dca3/family2 in testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:13,019 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-c5edef28457646a8be5e2fb7168ec592, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2a01493e7d074b0a8e262d90492ba9e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-1e672f4517804adc98af82b6a72d68c4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-64aa8daea9b84bdb88e24bd759e29f59] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp, totalSize=20.4 K 2023-03-30 16:55:13,020 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-32fea8bf809d45dda6acde20dc39e115, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:55:13,020 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-c5edef28457646a8be5e2fb7168ec592, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290050 2023-03-30 16:55:13,022 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2416e084ca9b4a9085ea7fde70748dfa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:13,022 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2a01493e7d074b0a8e262d90492ba9e3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:55:13,023 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-01b7deccdc3f4609b8f89bcbcbb9b1ee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:55:13,026 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,036 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-1e672f4517804adc98af82b6a72d68c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:13,037 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-64aa8daea9b84bdb88e24bd759e29f59, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:55:13,038 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:55:13,038 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:55:13,039 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29fad251876ccdb28c1e80a93ea7325 columnFamilyName family1 2023-03-30 16:55:13,086 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-091aa93aed084f5cadfe48960fd07f31 2023-03-30 16:55:13,106 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-1588d3d561964f8fb1984959c783dc2e 2023-03-30 16:55:13,121 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] throttle.PressureAwareThroughputController(145): fadbe83bb5f1f6bef301518ccc05dca3#family1#compaction#114 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:13,133 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-3fea413fcc6f43bfa48d5e9628ba6a8e 2023-03-30 16:55:13,140 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): fadbe83bb5f1f6bef301518ccc05dca3#family2#compaction#115 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:13,149 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-ca6332d0876048a18f6b383e8d554f52 2023-03-30 16:55:13,154 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(310): Store=b29fad251876ccdb28c1e80a93ea7325/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:13,155 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,158 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2 2023-03-30 16:55:13,158 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2 2023-03-30 16:55:13,158 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29fad251876ccdb28c1e80a93ea7325 columnFamilyName family2 2023-03-30 16:55:13,184 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-271513167c8342c5999637e89a2323f3 2023-03-30 16:55:13,189 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-58bbbd976dbb48b086469c4589270ab3 2023-03-30 16:55:13,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-30 16:55:13,195 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-c9d7402570734810ba9dcd4014768215 2023-03-30 16:55:13,202 DEBUG [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-f94fbf93d5934e278bbb9055d5d09de1 2023-03-30 16:55:13,202 INFO [StoreOpener-b29fad251876ccdb28c1e80a93ea7325-1] regionserver.HStore(310): Store=b29fad251876ccdb28c1e80a93ea7325/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:13,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,207 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family2/7dd591da20b146a9977bb6c0ae54b194 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/7dd591da20b146a9977bb6c0ae54b194 2023-03-30 16:55:13,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:13,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:13,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b29fad251876ccdb28c1e80a93ea7325; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74065933, jitterRate=0.10366840660572052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:13,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:13,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325., pid=102, masterSystemTime=1680195312900 2023-03-30 16:55:13,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-30 16:55:13,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-30 16:55:13,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:13,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:13,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:13,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80c0ffabf06d7dad81c5f34fac612af6, NAME => 'testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.', STARTKEY => '2', ENDKEY => ''} 2023-03-30 16:55:13,212 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-30 16:55:13,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,213 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fadbe83bb5f1f6bef301518ccc05dca3/family2 of fadbe83bb5f1f6bef301518ccc05dca3 into 7dd591da20b146a9977bb6c0ae54b194(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:13,213 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:13,213 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3., storeName=fadbe83bb5f1f6bef301518ccc05dca3/family2, priority=12, startTime=1680195313010; duration=0sec 2023-03-30 16:55:13,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=b29fad251876ccdb28c1e80a93ea7325, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:13,213 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-30 16:55:13,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195313213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195313213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195313213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195313213"}]},"ts":"1680195313213"} 2023-03-30 16:55:13,216 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-30 16:55:13,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-03-30 16:55:13,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure b29fad251876ccdb28c1e80a93ea7325, server=jenkins-hbase4.apache.org,39029,1680195214375 in 467 msec 2023-03-30 16:55:13,218 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b29fad251876ccdb28c1e80a93ea7325, ASSIGN in 626 msec 2023-03-30 16:55:13,219 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:55:13,219 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:55:13,220 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-30 16:55:13,220 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80c0ffabf06d7dad81c5f34fac612af6 columnFamilyName family1 2023-03-30 16:55:13,220 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1912): b29fad251876ccdb28c1e80a93ea7325/family1 is initiating minor compaction (all files) 2023-03-30 16:55:13,220 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b29fad251876ccdb28c1e80a93ea7325/family1 in testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:13,220 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-091aa93aed084f5cadfe48960fd07f31, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-1588d3d561964f8fb1984959c783dc2e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-ca6332d0876048a18f6b383e8d554f52, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-3fea413fcc6f43bfa48d5e9628ba6a8e] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp, totalSize=21.6 K 2023-03-30 16:55:13,222 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-091aa93aed084f5cadfe48960fd07f31, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290048 2023-03-30 16:55:13,222 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-1588d3d561964f8fb1984959c783dc2e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291177 2023-03-30 16:55:13,223 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-ca6332d0876048a18f6b383e8d554f52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:13,223 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-3fea413fcc6f43bfa48d5e9628ba6a8e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293683 2023-03-30 16:55:13,232 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-08a97a760b30471d8c4211df06c9e751 2023-03-30 16:55:13,239 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-4361876fef7d4de18308a6c1a4058898 2023-03-30 16:55:13,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-c5edef28457646a8be5e2fb7168ec592, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2a01493e7d074b0a8e262d90492ba9e3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-1e672f4517804adc98af82b6a72d68c4, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-64aa8daea9b84bdb88e24bd759e29f59] to archive 2023-03-30 16:55:13,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:13,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-c5edef28457646a8be5e2fb7168ec592 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-c5edef28457646a8be5e2fb7168ec592 2023-03-30 16:55:13,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2a01493e7d074b0a8e262d90492ba9e3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2a01493e7d074b0a8e262d90492ba9e3 2023-03-30 16:55:13,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-1e672f4517804adc98af82b6a72d68c4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-1e672f4517804adc98af82b6a72d68c4 2023-03-30 16:55:13,254 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-b998173087ec48779c5edea886d3e46c 2023-03-30 16:55:13,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-64aa8daea9b84bdb88e24bd759e29f59 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family2/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-64aa8daea9b84bdb88e24bd759e29f59 2023-03-30 16:55:13,267 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-d3574393c7ea457bbe327b83f1099447 2023-03-30 16:55:13,268 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(310): Store=80c0ffabf06d7dad81c5f34fac612af6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:13,268 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): b29fad251876ccdb28c1e80a93ea7325#family1#compaction#116 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:13,268 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,270 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2 2023-03-30 16:55:13,270 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2 2023-03-30 16:55:13,271 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80c0ffabf06d7dad81c5f34fac612af6 columnFamilyName family2 2023-03-30 16:55:13,286 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-3fb881c8bc334617895ab7d9c73d5476 2023-03-30 16:55:13,293 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-5a5823e4e3754e33865bde221fd7f296 2023-03-30 16:55:13,298 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-69176da70273463d95453168043d8aed 2023-03-30 16:55:13,303 DEBUG [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(539): loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-de9c8e67d0d44f7b9202a2c29a4dcb6f 2023-03-30 16:55:13,303 INFO [StoreOpener-80c0ffabf06d7dad81c5f34fac612af6-1] regionserver.HStore(310): Store=80c0ffabf06d7dad81c5f34fac612af6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:13,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:13,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:13,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80c0ffabf06d7dad81c5f34fac612af6; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60907406, jitterRate=-0.0924089252948761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:13,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:13,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6., pid=101, masterSystemTime=1680195312900 2023-03-30 16:55:13,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-30 16:55:13,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-30 16:55:13,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:13,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:13,310 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=80c0ffabf06d7dad81c5f34fac612af6, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:13,311 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680195313310"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195313310"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195313310"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195313310"}]},"ts":"1680195313310"} 2023-03-30 16:55:13,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-03-30 16:55:13,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 80c0ffabf06d7dad81c5f34fac612af6, server=jenkins-hbase4.apache.org,39029,1680195214375 in 564 msec 2023-03-30 16:55:13,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-03-30 16:55:13,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=80c0ffabf06d7dad81c5f34fac612af6, ASSIGN in 721 msec 2023-03-30 16:55:13,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195313314"}]},"ts":"1680195313314"} 2023-03-30 16:55:13,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-30 16:55:13,317 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-30 16:55:13,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 739 msec 2023-03-30 16:55:13,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-30 16:55:13,691 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-30 16:55:13,705 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:13,715 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:13,730 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:13,731 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:13,739 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-30 16:55:13,757 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-30 16:55:13,757 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:13,757 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(139): Connect 0x113978af to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:55:13,764 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5753ab19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:55:13,764 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:13,764 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:13,764 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:13,879 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033079339c5f26e74b09b4ca4071d37422d4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023033079339c5f26e74b09b4ca4071d37422d4 2023-03-30 16:55:13,881 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:13,899 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:55:13,902 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34834, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:55:13,910 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:55:13,919 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:55:13,940 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/52fab050274c467cb80ea38cbfac8061 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-30 16:55:13,941 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=32 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/52fab050274c467cb80ea38cbfac8061}] 2023-03-30 16:55:13,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/52fab050274c467cb80ea38cbfac8061 for inclusion in b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:55:13,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-30 16:55:13,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last=1 2023-03-30 16:55:13,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:13,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330/family1/52fab050274c467cb80ea38cbfac8061 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__erec92qs99ad4g1g1oulm3hqbo1dc677nveoq56old9b5qgtbm3qp6d8drquob93/family1/52fab050274c467cb80ea38cbfac8061 2023-03-30 16:55:13,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__erec92qs99ad4g1g1oulm3hqbo1dc677nveoq56old9b5qgtbm3qp6d8drquob93/family1/52fab050274c467cb80ea38cbfac8061 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/f071519f05d04b4c93783edf0a3ed2b7_SeqId_34_ 2023-03-30 16:55:13,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__erec92qs99ad4g1g1oulm3hqbo1dc677nveoq56old9b5qgtbm3qp6d8drquob93/family1/52fab050274c467cb80ea38cbfac8061 into b29fad251876ccdb28c1e80a93ea7325/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/f071519f05d04b4c93783edf0a3ed2b7_SeqId_34_ - updating store file list. 2023-03-30 16:55:13,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/f071519f05d04b4c93783edf0a3ed2b7_SeqId_34_ into b29fad251876ccdb28c1e80a93ea7325/family1 2023-03-30 16:55:13,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__erec92qs99ad4g1g1oulm3hqbo1dc677nveoq56old9b5qgtbm3qp6d8drquob93/family1/52fab050274c467cb80ea38cbfac8061 into b29fad251876ccdb28c1e80a93ea7325/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/f071519f05d04b4c93783edf0a3ed2b7_SeqId_34_) 2023-03-30 16:55:13,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__erec92qs99ad4g1g1oulm3hqbo1dc677nveoq56old9b5qgtbm3qp6d8drquob93/family1/52fab050274c467cb80ea38cbfac8061 2023-03-30 16:55:13,974 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:13,975 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:13,976 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230330265b2cb728514d0ba52064336c7d145a 2023-03-30 16:55:13,978 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303304eb42c6168c64b219797c367ad9825c4 2023-03-30 16:55:13,979 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230330aac88361285c4445994f9bc8c35f7273 2023-03-30 16:55:13,981 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/.tmp/family1/c97c2ab93aa6429185931e5c0a81036e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/c97c2ab93aa6429185931e5c0a81036e 2023-03-30 16:55:13,983 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230330feef965913be49e292e77117d417db98 2023-03-30 16:55:13,983 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-30 16:55:13,983 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230330' 2023-03-30 16:55:13,984 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:13,986 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fadbe83bb5f1f6bef301518ccc05dca3/family1 of fadbe83bb5f1f6bef301518ccc05dca3 into c97c2ab93aa6429185931e5c0a81036e(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:13,986 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:13,986 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3., storeName=fadbe83bb5f1f6bef301518ccc05dca3/family1, priority=12, startTime=1680195313010; duration=0sec 2023-03-30 16:55:13,986 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-30 16:55:13,986 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-30 16:55:13,988 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-30 16:55:13,989 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1912): b29fad251876ccdb28c1e80a93ea7325/family2 is initiating minor compaction (all files) 2023-03-30 16:55:13,989 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b29fad251876ccdb28c1e80a93ea7325/family2 in testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:13,989 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-c9d7402570734810ba9dcd4014768215, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-58bbbd976dbb48b086469c4589270ab3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-f94fbf93d5934e278bbb9055d5d09de1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-271513167c8342c5999637e89a2323f3] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp, totalSize=20.4 K 2023-03-30 16:55:13,989 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-c9d7402570734810ba9dcd4014768215, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290048 2023-03-30 16:55:13,990 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-58bbbd976dbb48b086469c4589270ab3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291177 2023-03-30 16:55:13,990 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-f94fbf93d5934e278bbb9055d5d09de1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:13,991 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-271513167c8342c5999637e89a2323f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293683 2023-03-30 16:55:14,009 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] throttle.PressureAwareThroughputController(145): b29fad251876ccdb28c1e80a93ea7325#family2#compaction#117 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:14,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-e1ecf56a9bf7486593b3a778f4568014, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-32fea8bf809d45dda6acde20dc39e115, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2416e084ca9b4a9085ea7fde70748dfa, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-01b7deccdc3f4609b8f89bcbcbb9b1ee] to archive 2023-03-30 16:55:14,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:14,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-e1ecf56a9bf7486593b3a778f4568014 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-e1ecf56a9bf7486593b3a778f4568014 2023-03-30 16:55:14,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-32fea8bf809d45dda6acde20dc39e115 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-32fea8bf809d45dda6acde20dc39e115 2023-03-30 16:55:14,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2416e084ca9b4a9085ea7fde70748dfa to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-2416e084ca9b4a9085ea7fde70748dfa 2023-03-30 16:55:14,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-01b7deccdc3f4609b8f89bcbcbb9b1ee to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/testCompactionWithHFileLink=fadbe83bb5f1f6bef301518ccc05dca3-01b7deccdc3f4609b8f89bcbcbb9b1ee 2023-03-30 16:55:14,101 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family1/ed5e3663ace041c884b7a491b9987e49 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/ed5e3663ace041c884b7a491b9987e49 2023-03-30 16:55:14,106 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b29fad251876ccdb28c1e80a93ea7325/family1 of b29fad251876ccdb28c1e80a93ea7325 into ed5e3663ace041c884b7a491b9987e49(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:14,106 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:14,106 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325., storeName=b29fad251876ccdb28c1e80a93ea7325/family1, priority=12, startTime=1680195313210; duration=0sec 2023-03-30 16:55:14,106 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-30 16:55:14,108 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-30 16:55:14,110 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-30 16:55:14,110 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1912): 80c0ffabf06d7dad81c5f34fac612af6/family2 is initiating minor compaction (all files) 2023-03-30 16:55:14,110 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 80c0ffabf06d7dad81c5f34fac612af6/family2 in testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:14,110 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-3fb881c8bc334617895ab7d9c73d5476, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-69176da70273463d95453168043d8aed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-de9c8e67d0d44f7b9202a2c29a4dcb6f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-5a5823e4e3754e33865bde221fd7f296] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp, totalSize=20.4 K 2023-03-30 16:55:14,111 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-3fb881c8bc334617895ab7d9c73d5476, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290051 2023-03-30 16:55:14,111 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-69176da70273463d95453168043d8aed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:55:14,112 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-de9c8e67d0d44f7b9202a2c29a4dcb6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:14,112 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-5a5823e4e3754e33865bde221fd7f296, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:55:14,138 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] throttle.PressureAwareThroughputController(145): 80c0ffabf06d7dad81c5f34fac612af6#family2#compaction#118 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:14,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-091aa93aed084f5cadfe48960fd07f31, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-1588d3d561964f8fb1984959c783dc2e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-ca6332d0876048a18f6b383e8d554f52, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-3fea413fcc6f43bfa48d5e9628ba6a8e] to archive 2023-03-30 16:55:14,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:14,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-091aa93aed084f5cadfe48960fd07f31 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-091aa93aed084f5cadfe48960fd07f31 2023-03-30 16:55:14,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-1588d3d561964f8fb1984959c783dc2e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-1588d3d561964f8fb1984959c783dc2e 2023-03-30 16:55:14,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-ca6332d0876048a18f6b383e8d554f52 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-ca6332d0876048a18f6b383e8d554f52 2023-03-30 16:55:14,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-3fea413fcc6f43bfa48d5e9628ba6a8e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family1/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-3fea413fcc6f43bfa48d5e9628ba6a8e 2023-03-30 16:55:14,245 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330bce55971dcd949e989eedadeba4fb29d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230330bce55971dcd949e989eedadeba4fb29d 2023-03-30 16:55:14,246 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:14,267 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303307933359b827748d8a4c15111f53ca2fd to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303307933359b827748d8a4c15111f53ca2fd 2023-03-30 16:55:14,267 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:14,278 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/574f3078545a4cf6ac2212a888caa32c first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-30 16:55:14,278 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/574f3078545a4cf6ac2212a888caa32c}] 2023-03-30 16:55:14,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/574f3078545a4cf6ac2212a888caa32c for inclusion in 80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:55:14,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-30 16:55:14,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-30 16:55:14,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:14,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330/family1/574f3078545a4cf6ac2212a888caa32c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__7g51p2hq04agotphtd21bq08rbnjrctaab055beqpm2b2kjdnoe3u239uhtsqlok/family1/574f3078545a4cf6ac2212a888caa32c 2023-03-30 16:55:14,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__7g51p2hq04agotphtd21bq08rbnjrctaab055beqpm2b2kjdnoe3u239uhtsqlok/family1/574f3078545a4cf6ac2212a888caa32c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_ 2023-03-30 16:55:14,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__7g51p2hq04agotphtd21bq08rbnjrctaab055beqpm2b2kjdnoe3u239uhtsqlok/family1/574f3078545a4cf6ac2212a888caa32c into 80c0ffabf06d7dad81c5f34fac612af6/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_ - updating store file list. 2023-03-30 16:55:14,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_ into 80c0ffabf06d7dad81c5f34fac612af6/family1 2023-03-30 16:55:14,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__7g51p2hq04agotphtd21bq08rbnjrctaab055beqpm2b2kjdnoe3u239uhtsqlok/family1/574f3078545a4cf6ac2212a888caa32c into 80c0ffabf06d7dad81c5f34fac612af6/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_) 2023-03-30 16:55:14,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__7g51p2hq04agotphtd21bq08rbnjrctaab055beqpm2b2kjdnoe3u239uhtsqlok/family1/574f3078545a4cf6ac2212a888caa32c 2023-03-30 16:55:14,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:14,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-30 16:55:14,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): 80c0ffabf06d7dad81c5f34fac612af6/family1 is initiating minor compaction (all files) 2023-03-30 16:55:14,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@67c687cd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-30 16:55:14,305 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:14,306 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:14,306 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/78e57161bdb94fa8b0ae4db33da65a3d first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-30 16:55:14,307 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/78e57161bdb94fa8b0ae4db33da65a3d}] 2023-03-30 16:55:14,311 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303302a1c8618b79043c49ccf03727dd96f50 2023-03-30 16:55:14,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/78e57161bdb94fa8b0ae4db33da65a3d for inclusion in fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:55:14,312 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023033034e62e2f20df47db89abcd6c95cd4544 2023-03-30 16:55:14,313 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023033036f65c48f5984b0f932d9f86b2a078ff 2023-03-30 16:55:14,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-30 16:55:14,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-30 16:55:14,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:14,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330/family1/78e57161bdb94fa8b0ae4db33da65a3d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__f820n7qlc2gek3nb8fcrdsp5trs8dajbtupca010avigu0bsh68kl5t1111r0e3/family1/78e57161bdb94fa8b0ae4db33da65a3d 2023-03-30 16:55:14,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__f820n7qlc2gek3nb8fcrdsp5trs8dajbtupca010avigu0bsh68kl5t1111r0e3/family1/78e57161bdb94fa8b0ae4db33da65a3d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/89bf1d5aed8245e7aa2b7813b2f3dc8c_SeqId_36_ 2023-03-30 16:55:14,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__f820n7qlc2gek3nb8fcrdsp5trs8dajbtupca010avigu0bsh68kl5t1111r0e3/family1/78e57161bdb94fa8b0ae4db33da65a3d into fadbe83bb5f1f6bef301518ccc05dca3/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/89bf1d5aed8245e7aa2b7813b2f3dc8c_SeqId_36_ - updating store file list. 2023-03-30 16:55:14,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/89bf1d5aed8245e7aa2b7813b2f3dc8c_SeqId_36_ into fadbe83bb5f1f6bef301518ccc05dca3/family1 2023-03-30 16:55:14,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__f820n7qlc2gek3nb8fcrdsp5trs8dajbtupca010avigu0bsh68kl5t1111r0e3/family1/78e57161bdb94fa8b0ae4db33da65a3d into fadbe83bb5f1f6bef301518ccc05dca3/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/family1/89bf1d5aed8245e7aa2b7813b2f3dc8c_SeqId_36_) 2023-03-30 16:55:14,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testCompactionWithHFileLink__f820n7qlc2gek3nb8fcrdsp5trs8dajbtupca010avigu0bsh68kl5t1111r0e3/family1/78e57161bdb94fa8b0ae4db33da65a3d 2023-03-30 16:55:14,328 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230330a8a01a860ac5474d82098d17ff6882c1 2023-03-30 16:55:14,328 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-30 16:55:14,328 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230330' 2023-03-30 16:55:14,328 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:14,329 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:14,329 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:14,330 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303301afc15e2fe0b4b93a49a2c4bb7fdc74d 2023-03-30 16:55:14,331 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303305c7423669df04aeab4c0526670fa0dad 2023-03-30 16:55:14,332 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023033077da9a2ac76a4d8b8d9864b153e46e2e 2023-03-30 16:55:14,333 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230330ec7eb9b99c254fc7837f6ea38de48087 2023-03-30 16:55:14,333 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-30 16:55:14,333 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230330' 2023-03-30 16:55:14,334 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230330 for table='testCompactionWithHFileLink' and column='family1' 2023-03-30 16:55:14,335 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-30 16:55:14,339 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:14,342 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:14,347 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:14,348 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:14,356 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:14,357 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:14,377 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=278 (was 262) - Thread LEAK? -, OpenFileDescriptor=695 (was 660) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=420 (was 433), ProcessCount=169 (was 169), AvailableMemoryMB=4382 (was 4577) 2023-03-30 16:55:14,393 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=278, OpenFileDescriptor=695, MaxFileDescriptor=60000, SystemLoadAverage=420, ProcessCount=169, AvailableMemoryMB=4382 2023-03-30 16:55:14,399 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-03-30 16:55:14,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-30 16:55:14,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-30 16:55:14,409 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-30 16:55:14,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 11 msec 2023-03-30 16:55:14,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-30 16:55:14,509 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-30 16:55:14,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-30 16:55:14,512 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:55:14,512 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-30 16:55:14,512 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:55:14,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-30 16:55:14,514 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:14,514 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:14,515 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:14,515 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef empty. 2023-03-30 16:55:14,515 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde empty. 2023-03-30 16:55:14,515 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92 empty. 2023-03-30 16:55:14,515 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:14,515 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:14,515 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:14,516 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-30 16:55:14,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-30 16:55:14,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-30 16:55:14,842 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/.tmp/family2/ef40d003a09e49ff898e9283b9d469dd as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/ef40d003a09e49ff898e9283b9d469dd 2023-03-30 16:55:14,847 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b29fad251876ccdb28c1e80a93ea7325/family2 of b29fad251876ccdb28c1e80a93ea7325 into ef40d003a09e49ff898e9283b9d469dd(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:14,847 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:14,847 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325., storeName=b29fad251876ccdb28c1e80a93ea7325/family2, priority=12, startTime=1680195313210; duration=0sec 2023-03-30 16:55:14,848 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-30 16:55:14,848 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 80c0ffabf06d7dad81c5f34fac612af6/family1 in testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:14,848 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-b998173087ec48779c5edea886d3e46c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-4361876fef7d4de18308a6c1a4058898, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-d3574393c7ea457bbe327b83f1099447, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-08a97a760b30471d8c4211df06c9e751, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp, totalSize=28.9 K 2023-03-30 16:55:14,849 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-b998173087ec48779c5edea886d3e46c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195290051 2023-03-30 16:55:14,849 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-4361876fef7d4de18308a6c1a4058898, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195291178 2023-03-30 16:55:14,850 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-d3574393c7ea457bbe327b83f1099447, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195292251 2023-03-30 16:55:14,851 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-08a97a760b30471d8c4211df06c9e751, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195293684 2023-03-30 16:55:14,852 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting 8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1680195290051 2023-03-30 16:55:14,892 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] throttle.PressureAwareThroughputController(145): 80c0ffabf06d7dad81c5f34fac612af6#family1#compaction#119 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:14,929 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-30 16:55:14,931 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 803f43c55f4cd7fc65b94b0eb61debde, NAME => 'ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:55:14,931 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => d3e85d08c9236402a775ce01ab813cef, NAME => 'ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:55:14,937 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9cc307f3f7cba7ac9b36daf0f32feb92, NAME => 'ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:55:14,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-c9d7402570734810ba9dcd4014768215, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-58bbbd976dbb48b086469c4589270ab3, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-f94fbf93d5934e278bbb9055d5d09de1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-271513167c8342c5999637e89a2323f3] to archive 2023-03-30 16:55:14,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:14,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-c9d7402570734810ba9dcd4014768215 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-c9d7402570734810ba9dcd4014768215 2023-03-30 16:55:14,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-58bbbd976dbb48b086469c4589270ab3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-58bbbd976dbb48b086469c4589270ab3 2023-03-30 16:55:14,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-f94fbf93d5934e278bbb9055d5d09de1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-f94fbf93d5934e278bbb9055d5d09de1 2023-03-30 16:55:14,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-271513167c8342c5999637e89a2323f3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/family2/testCompactionWithHFileLink=b29fad251876ccdb28c1e80a93ea7325-271513167c8342c5999637e89a2323f3 2023-03-30 16:55:14,980 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:14,980 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 9cc307f3f7cba7ac9b36daf0f32feb92, disabling compactions & flushes 2023-03-30 16:55:14,980 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:14,980 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:14,980 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. after waiting 0 ms 2023-03-30 16:55:14,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:14,981 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:14,981 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:15,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-30 16:55:15,374 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:15,374 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 803f43c55f4cd7fc65b94b0eb61debde, disabling compactions & flushes 2023-03-30 16:55:15,374 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:15,374 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:15,374 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. after waiting 0 ms 2023-03-30 16:55:15,374 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:15,374 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:15,374 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:15,397 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:15,397 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing d3e85d08c9236402a775ce01ab813cef, disabling compactions & flushes 2023-03-30 16:55:15,397 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:15,397 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:15,397 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. after waiting 0 ms 2023-03-30 16:55:15,397 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:15,397 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:15,397 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:15,400 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:55:15,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680195315401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195315401"}]},"ts":"1680195315401"} 2023-03-30 16:55:15,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680195315401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195315401"}]},"ts":"1680195315401"} 2023-03-30 16:55:15,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680195315401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195315401"}]},"ts":"1680195315401"} 2023-03-30 16:55:15,403 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-30 16:55:15,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:55:15,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195315403"}]},"ts":"1680195315403"} 2023-03-30 16:55:15,405 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-30 16:55:15,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=803f43c55f4cd7fc65b94b0eb61debde, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d3e85d08c9236402a775ce01ab813cef, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9cc307f3f7cba7ac9b36daf0f32feb92, ASSIGN}] 2023-03-30 16:55:15,411 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d3e85d08c9236402a775ce01ab813cef, ASSIGN 2023-03-30 16:55:15,411 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=803f43c55f4cd7fc65b94b0eb61debde, ASSIGN 2023-03-30 16:55:15,411 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9cc307f3f7cba7ac9b36daf0f32feb92, ASSIGN 2023-03-30 16:55:15,412 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d3e85d08c9236402a775ce01ab813cef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:55:15,412 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9cc307f3f7cba7ac9b36daf0f32feb92, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:55:15,413 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=803f43c55f4cd7fc65b94b0eb61debde, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:55:15,419 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family2/606a096122eb48d28abae0b59bc9640d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/606a096122eb48d28abae0b59bc9640d 2023-03-30 16:55:15,427 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/.tmp/family1/28514905a62644a8b673656306a7055b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/28514905a62644a8b673656306a7055b 2023-03-30 16:55:15,427 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 80c0ffabf06d7dad81c5f34fac612af6/family2 of 80c0ffabf06d7dad81c5f34fac612af6 into 606a096122eb48d28abae0b59bc9640d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:15,427 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:15,428 INFO [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6., storeName=80c0ffabf06d7dad81c5f34fac612af6/family2, priority=12, startTime=1680195313309; duration=1sec 2023-03-30 16:55:15,428 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-30 16:55:15,428 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-03-30 16:55:15,428 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-30 16:55:15,428 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-30 16:55:15,428 DEBUG [RS:0;jenkins-hbase4:39029-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. because compaction request was cancelled 2023-03-30 16:55:15,434 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 80c0ffabf06d7dad81c5f34fac612af6/family1 of 80c0ffabf06d7dad81c5f34fac612af6 into 28514905a62644a8b673656306a7055b(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:15,434 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:15,434 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1680195314302; duration=0sec 2023-03-30 16:55:15,434 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:55:15,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-b998173087ec48779c5edea886d3e46c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-4361876fef7d4de18308a6c1a4058898, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-d3574393c7ea457bbe327b83f1099447, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-08a97a760b30471d8c4211df06c9e751, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_] to archive 2023-03-30 16:55:15,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:15,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-b998173087ec48779c5edea886d3e46c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-b998173087ec48779c5edea886d3e46c 2023-03-30 16:55:15,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-4361876fef7d4de18308a6c1a4058898 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-4361876fef7d4de18308a6c1a4058898 2023-03-30 16:55:15,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-d3574393c7ea457bbe327b83f1099447 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-d3574393c7ea457bbe327b83f1099447 2023-03-30 16:55:15,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-08a97a760b30471d8c4211df06c9e751 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-08a97a760b30471d8c4211df06c9e751 2023-03-30 16:55:15,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family1/8c0b56524f8c4a6fbc2a5bfe75108253_SeqId_34_ 2023-03-30 16:55:15,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-3fb881c8bc334617895ab7d9c73d5476, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-69176da70273463d95453168043d8aed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-de9c8e67d0d44f7b9202a2c29a4dcb6f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-5a5823e4e3754e33865bde221fd7f296] to archive 2023-03-30 16:55:15,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:15,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-3fb881c8bc334617895ab7d9c73d5476 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-3fb881c8bc334617895ab7d9c73d5476 2023-03-30 16:55:15,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-69176da70273463d95453168043d8aed to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-69176da70273463d95453168043d8aed 2023-03-30 16:55:15,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-de9c8e67d0d44f7b9202a2c29a4dcb6f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-de9c8e67d0d44f7b9202a2c29a4dcb6f 2023-03-30 16:55:15,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-5a5823e4e3754e33865bde221fd7f296 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/family2/testCompactionWithHFileLink=80c0ffabf06d7dad81c5f34fac612af6-5a5823e4e3754e33865bde221fd7f296 2023-03-30 16:55:15,565 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d3e85d08c9236402a775ce01ab813cef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:15,565 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=803f43c55f4cd7fc65b94b0eb61debde, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:15,565 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=9cc307f3f7cba7ac9b36daf0f32feb92, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:15,565 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680195315565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195315565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195315565"}]},"ts":"1680195315565"} 2023-03-30 16:55:15,565 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680195315565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195315565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195315565"}]},"ts":"1680195315565"} 2023-03-30 16:55:15,565 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680195315565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195315565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195315565"}]},"ts":"1680195315565"} 2023-03-30 16:55:15,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure d3e85d08c9236402a775ce01ab813cef, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:15,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 9cc307f3f7cba7ac9b36daf0f32feb92, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:15,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 803f43c55f4cd7fc65b94b0eb61debde, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:15,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-30 16:55:15,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:15,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d3e85d08c9236402a775ce01ab813cef, NAME => 'ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef.', STARTKEY => '1', ENDKEY => '2'} 2023-03-30 16:55:15,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:15,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,724 INFO [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,726 DEBUG [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1 2023-03-30 16:55:15,726 DEBUG [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1 2023-03-30 16:55:15,727 INFO [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3e85d08c9236402a775ce01ab813cef columnFamilyName family1 2023-03-30 16:55:15,728 INFO [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] regionserver.HStore(310): Store=d3e85d08c9236402a775ce01ab813cef/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:15,728 INFO [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,729 DEBUG [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2 2023-03-30 16:55:15,729 DEBUG [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2 2023-03-30 16:55:15,730 INFO [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3e85d08c9236402a775ce01ab813cef columnFamilyName family2 2023-03-30 16:55:15,731 INFO [StoreOpener-d3e85d08c9236402a775ce01ab813cef-1] regionserver.HStore(310): Store=d3e85d08c9236402a775ce01ab813cef/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:15,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:15,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:15,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:55:15,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d3e85d08c9236402a775ce01ab813cef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72272546, jitterRate=0.07694485783576965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:15,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:15,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef., pid=109, masterSystemTime=1680195315719 2023-03-30 16:55:15,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:15,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:15,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:15,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 803f43c55f4cd7fc65b94b0eb61debde, NAME => 'ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde.', STARTKEY => '', ENDKEY => '1'} 2023-03-30 16:55:15,740 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d3e85d08c9236402a775ce01ab813cef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:15,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:15,740 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680195315740"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195315740"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195315740"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195315740"}]},"ts":"1680195315740"} 2023-03-30 16:55:15,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,742 INFO [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-03-30 16:55:15,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure d3e85d08c9236402a775ce01ab813cef, server=jenkins-hbase4.apache.org,39029,1680195214375 in 174 msec 2023-03-30 16:55:15,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d3e85d08c9236402a775ce01ab813cef, ASSIGN in 334 msec 2023-03-30 16:55:15,744 DEBUG [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1 2023-03-30 16:55:15,744 DEBUG [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1 2023-03-30 16:55:15,744 INFO [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 803f43c55f4cd7fc65b94b0eb61debde columnFamilyName family1 2023-03-30 16:55:15,745 INFO [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] regionserver.HStore(310): Store=803f43c55f4cd7fc65b94b0eb61debde/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:15,745 INFO [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,746 DEBUG [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2 2023-03-30 16:55:15,746 DEBUG [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2 2023-03-30 16:55:15,747 INFO [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 803f43c55f4cd7fc65b94b0eb61debde columnFamilyName family2 2023-03-30 16:55:15,747 INFO [StoreOpener-803f43c55f4cd7fc65b94b0eb61debde-1] regionserver.HStore(310): Store=803f43c55f4cd7fc65b94b0eb61debde/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:15,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:15,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:15,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:55:15,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 803f43c55f4cd7fc65b94b0eb61debde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74026419, jitterRate=0.10307960212230682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:15,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:15,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde., pid=111, masterSystemTime=1680195315719 2023-03-30 16:55:15,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:15,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:15,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:15,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9cc307f3f7cba7ac9b36daf0f32feb92, NAME => 'ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92.', STARTKEY => '2', ENDKEY => ''} 2023-03-30 16:55:15,755 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=803f43c55f4cd7fc65b94b0eb61debde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:15,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:15,755 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680195315755"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195315755"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195315755"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195315755"}]},"ts":"1680195315755"} 2023-03-30 16:55:15,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,756 INFO [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=106 2023-03-30 16:55:15,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 803f43c55f4cd7fc65b94b0eb61debde, server=jenkins-hbase4.apache.org,39029,1680195214375 in 188 msec 2023-03-30 16:55:15,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=803f43c55f4cd7fc65b94b0eb61debde, ASSIGN in 348 msec 2023-03-30 16:55:15,758 DEBUG [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1 2023-03-30 16:55:15,758 DEBUG [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1 2023-03-30 16:55:15,759 INFO [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cc307f3f7cba7ac9b36daf0f32feb92 columnFamilyName family1 2023-03-30 16:55:15,759 INFO [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] regionserver.HStore(310): Store=9cc307f3f7cba7ac9b36daf0f32feb92/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:15,760 INFO [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,761 DEBUG [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2 2023-03-30 16:55:15,761 DEBUG [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2 2023-03-30 16:55:15,761 INFO [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cc307f3f7cba7ac9b36daf0f32feb92 columnFamilyName family2 2023-03-30 16:55:15,762 INFO [StoreOpener-9cc307f3f7cba7ac9b36daf0f32feb92-1] regionserver.HStore(310): Store=9cc307f3f7cba7ac9b36daf0f32feb92/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:15,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:15,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:15,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:55:15,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9cc307f3f7cba7ac9b36daf0f32feb92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61694187, jitterRate=-0.08068497478961945}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:15,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92., pid=110, masterSystemTime=1680195315719 2023-03-30 16:55:15,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:15,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:15,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=9cc307f3f7cba7ac9b36daf0f32feb92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:15,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680195315771"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195315771"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195315771"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195315771"}]},"ts":"1680195315771"} 2023-03-30 16:55:15,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-03-30 16:55:15,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 9cc307f3f7cba7ac9b36daf0f32feb92, server=jenkins-hbase4.apache.org,39029,1680195214375 in 205 msec 2023-03-30 16:55:15,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-03-30 16:55:15,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9cc307f3f7cba7ac9b36daf0f32feb92, ASSIGN in 364 msec 2023-03-30 16:55:15,775 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:55:15,775 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195315775"}]},"ts":"1680195315775"} 2023-03-30 16:55:15,776 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-30 16:55:15,778 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:55:15,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2690 sec 2023-03-30 16:55:16,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-30 16:55:16,619 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-30 16:55:16,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:16,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:16,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:16,653 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:16,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-30 16:55:16,656 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-30 16:55:16,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:16,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-30 16:55:16,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-30 16:55:16,657 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:16,657 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:16,659 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:16,659 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:16,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:16,660 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:16,660 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:16,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:16,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-30 16:55:16,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-30 16:55:16,664 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-30 16:55:16,664 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:16,664 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-30 16:55:16,672 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:16,672 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. started... 2023-03-30 16:55:16,675 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3e85d08c9236402a775ce01ab813cef 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:55:16,680 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:16,680 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:16,680 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:16,680 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:16,680 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. started... 2023-03-30 16:55:16,680 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. started... 2023-03-30 16:55:16,681 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9cc307f3f7cba7ac9b36daf0f32feb92 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:55:16,682 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 803f43c55f4cd7fc65b94b0eb61debde 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:55:16,716 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033066850a3ad13540e0846620c617afd1b2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023033066850a3ad13540e0846620c617afd1b2 2023-03-30 16:55:16,720 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033028b67918edd24125abf52462707b851f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023033028b67918edd24125abf52462707b851f 2023-03-30 16:55:16,730 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/28de491f8a8f45de9a1bc98c4bea3a0c 2023-03-30 16:55:16,750 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330f95fdff5813d422bac8845e901c8bf52 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230330f95fdff5813d422bac8845e901c8bf52 2023-03-30 16:55:17,106 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330703119fb7ca84b87ae1fd659a41e6321 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230330703119fb7ca84b87ae1fd659a41e6321 2023-03-30 16:55:17,127 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/56c39ca850224adc89a5ef4ab9e2e17a 2023-03-30 16:55:17,155 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/d619c8376a2a4fc6a189c34a3f60ced1 2023-03-30 16:55:17,159 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/28de491f8a8f45de9a1bc98c4bea3a0c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/28de491f8a8f45de9a1bc98c4bea3a0c 2023-03-30 16:55:17,163 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/28de491f8a8f45de9a1bc98c4bea3a0c, entries=4, sequenceid=5, filesize=5.4 K 2023-03-30 16:55:17,164 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/d619c8376a2a4fc6a189c34a3f60ced1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/d619c8376a2a4fc6a189c34a3f60ced1 2023-03-30 16:55:17,167 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/d619c8376a2a4fc6a189c34a3f60ced1, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:55:17,168 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 803f43c55f4cd7fc65b94b0eb61debde in 486ms, sequenceid=5, compaction requested=false 2023-03-30 16:55:17,168 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-30 16:55:17,169 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:17,169 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:17,169 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:17,511 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/652230c16363487e9a52d55505f5ddde 2023-03-30 16:55:17,548 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330fb665abcb79c44bab97ecaf4656fadf3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230330fb665abcb79c44bab97ecaf4656fadf3 2023-03-30 16:55:17,929 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303309a96f35a68f44d1298ec2a1676733c01 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303309a96f35a68f44d1298ec2a1676733c01 2023-03-30 16:55:17,940 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/2e1a4bd669224d008b8daab567623663 2023-03-30 16:55:17,944 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/652230c16363487e9a52d55505f5ddde as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/652230c16363487e9a52d55505f5ddde 2023-03-30 16:55:17,949 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/652230c16363487e9a52d55505f5ddde, entries=4, sequenceid=5, filesize=5.4 K 2023-03-30 16:55:17,950 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/2e1a4bd669224d008b8daab567623663 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/2e1a4bd669224d008b8daab567623663 2023-03-30 16:55:17,955 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/76f4db601a574f5b87ec598db04b577b 2023-03-30 16:55:17,957 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/2e1a4bd669224d008b8daab567623663, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:55:17,959 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d3e85d08c9236402a775ce01ab813cef in 1284ms, sequenceid=5, compaction requested=false 2023-03-30 16:55:17,961 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:17,961 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:17,961 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:17,963 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/56c39ca850224adc89a5ef4ab9e2e17a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/56c39ca850224adc89a5ef4ab9e2e17a 2023-03-30 16:55:17,967 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/56c39ca850224adc89a5ef4ab9e2e17a, entries=4, sequenceid=5, filesize=5.4 K 2023-03-30 16:55:17,967 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/76f4db601a574f5b87ec598db04b577b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/76f4db601a574f5b87ec598db04b577b 2023-03-30 16:55:17,971 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/76f4db601a574f5b87ec598db04b577b, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:55:17,971 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9cc307f3f7cba7ac9b36daf0f32feb92 in 1290ms, sequenceid=5, compaction requested=false 2023-03-30 16:55:17,972 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:17,972 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-30 16:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-30 16:55:17,974 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:17,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-30 16:55:17,976 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-30 16:55:17,976 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@443f303e[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:17,977 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-30 16:55:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-30 16:55:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-30 16:55:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-30 16:55:17,979 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,979 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:17,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-30 16:55:17,981 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-30 16:55:17,981 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:17,981 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:17,981 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-30 16:55:17,981 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:17,984 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:17,984 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:17,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:17,984 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:17,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:17,985 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:17,986 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:17,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:17,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:17,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:17,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:17,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:17,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:17,989 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:17,989 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-30 16:55:17,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-30 16:55:17,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:17,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:17,989 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:17,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:17,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:17,989 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:17,989 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:18,089 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:18,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:18,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:18,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:18,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:18,096 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:18,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:18,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-30 16:55:18,097 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-30 16:55:18,098 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:18,098 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-30 16:55:18,098 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-30 16:55:18,099 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:18,099 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:18,100 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:18,100 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:18,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:18,100 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:18,100 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:18,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:18,101 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-30 16:55:18,102 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-30 16:55:18,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-30 16:55:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-30 16:55:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-30 16:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. started... 2023-03-30 16:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:18,102 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3e85d08c9236402a775ce01ab813cef 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. started... 2023-03-30 16:55:18,103 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 803f43c55f4cd7fc65b94b0eb61debde 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:55:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:18,104 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:18,104 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. started... 2023-03-30 16:55:18,104 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9cc307f3f7cba7ac9b36daf0f32feb92 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:55:18,122 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303308cef0d4e7d854dbb95caa8fb88cb2396 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303308cef0d4e7d854dbb95caa8fb88cb2396 2023-03-30 16:55:18,142 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/7910f7490a2e439ba91056636ce2af32 2023-03-30 16:55:18,405 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:55:18,522 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330585a92d2eba6423a8dc8e057cae44d05 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230330585a92d2eba6423a8dc8e057cae44d05 2023-03-30 16:55:18,546 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303307210dcc69a0c4cdab1a21d85ab42b90c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303307210dcc69a0c4cdab1a21d85ab42b90c 2023-03-30 16:55:18,557 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330f29c060d0ee24db89e2e9012e6f64e59 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230330f29c060d0ee24db89e2e9012e6f64e59 2023-03-30 16:55:18,928 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/f9a2e674bb174b5da506f51b9bb92ee0 2023-03-30 16:55:18,952 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/5d0db43b9f334e25805be702b3d75766 2023-03-30 16:55:18,970 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/e86300e1a5a845788a47074ceb32ddd8 2023-03-30 16:55:18,974 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/7910f7490a2e439ba91056636ce2af32 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/7910f7490a2e439ba91056636ce2af32 2023-03-30 16:55:18,979 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/7910f7490a2e439ba91056636ce2af32, entries=4, sequenceid=9, filesize=5.4 K 2023-03-30 16:55:18,979 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/e86300e1a5a845788a47074ceb32ddd8 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/e86300e1a5a845788a47074ceb32ddd8 2023-03-30 16:55:18,983 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/e86300e1a5a845788a47074ceb32ddd8, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:55:18,983 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 803f43c55f4cd7fc65b94b0eb61debde in 880ms, sequenceid=9, compaction requested=false 2023-03-30 16:55:18,983 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:18,983 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:18,984 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:19,365 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330dbf36e2235e948f7902ded90d98f1c19 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230330dbf36e2235e948f7902ded90d98f1c19 2023-03-30 16:55:19,374 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/a8c481ebf5a343d8874aab2c468d7760 2023-03-30 16:55:19,380 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/f9a2e674bb174b5da506f51b9bb92ee0 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/f9a2e674bb174b5da506f51b9bb92ee0 2023-03-30 16:55:19,382 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330e160bfdbd1c84d66bc848f4bc455a137 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230330e160bfdbd1c84d66bc848f4bc455a137 2023-03-30 16:55:19,385 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/f9a2e674bb174b5da506f51b9bb92ee0, entries=4, sequenceid=9, filesize=5.4 K 2023-03-30 16:55:19,386 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/a8c481ebf5a343d8874aab2c468d7760 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/a8c481ebf5a343d8874aab2c468d7760 2023-03-30 16:55:19,388 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/b51ffbd035164d4895355c56373e9478 2023-03-30 16:55:19,389 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/a8c481ebf5a343d8874aab2c468d7760, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:55:19,390 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9cc307f3f7cba7ac9b36daf0f32feb92 in 1286ms, sequenceid=9, compaction requested=false 2023-03-30 16:55:19,390 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:19,390 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:19,395 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/5d0db43b9f334e25805be702b3d75766 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/5d0db43b9f334e25805be702b3d75766 2023-03-30 16:55:19,401 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/5d0db43b9f334e25805be702b3d75766, entries=4, sequenceid=9, filesize=5.4 K 2023-03-30 16:55:19,403 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/b51ffbd035164d4895355c56373e9478 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/b51ffbd035164d4895355c56373e9478 2023-03-30 16:55:19,407 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/b51ffbd035164d4895355c56373e9478, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:55:19,408 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d3e85d08c9236402a775ce01ab813cef in 1305ms, sequenceid=9, compaction requested=false 2023-03-30 16:55:19,408 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:19,408 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-30 16:55:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-30 16:55:19,410 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:19,410 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:19,411 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:19,411 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:19,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-30 16:55:19,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64715846[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:19,412 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-30 16:55:19,412 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,414 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,414 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-30 16:55:19,414 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-30 16:55:19,414 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,414 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:19,414 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:19,419 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,419 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-30 16:55:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:19,419 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:19,419 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-30 16:55:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:19,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-30 16:55:19,423 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-30 16:55:19,423 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:19,423 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:19,423 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-30 16:55:19,423 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:19,424 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,425 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:19,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,425 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:19,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:19,425 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:19,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:19,427 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:19,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:19,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,430 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,430 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:19,430 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:19,430 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:19,430 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-30 16:55:19,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:19,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:19,430 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:19,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:19,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:19,430 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:19,431 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,431 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,430 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:19,431 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:19,431 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,431 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:19,431 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:19,531 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:19,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:19,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:19,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:19,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:19,538 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:19,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:19,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-30 16:55:19,541 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-30 16:55:19,541 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:19,542 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-30 16:55:19,542 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-30 16:55:19,542 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,542 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:19,544 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:19,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:19,544 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:19,545 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:19,545 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:19,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:19,547 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-30 16:55:19,547 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-30 16:55:19,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-30 16:55:19,547 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-30 16:55:19,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:19,548 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-30 16:55:19,549 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:19,550 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. started... 2023-03-30 16:55:19,550 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3e85d08c9236402a775ce01ab813cef 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:55:19,550 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:19,550 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. started... 2023-03-30 16:55:19,550 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 803f43c55f4cd7fc65b94b0eb61debde 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:55:19,551 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:19,551 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:19,551 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:19,551 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. started... 2023-03-30 16:55:19,551 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9cc307f3f7cba7ac9b36daf0f32feb92 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:55:19,576 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303305a549e2ff74149e18a051c1c1c87b35c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303305a549e2ff74149e18a051c1c1c87b35c 2023-03-30 16:55:19,973 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330d82f3fac25d8452e9e2f3a2430d0d964 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230330d82f3fac25d8452e9e2f3a2430d0d964 2023-03-30 16:55:19,985 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/084c5e36cd694e1eb0ef071217751eac 2023-03-30 16:55:19,996 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033011e615bcffc84c248aa29c9c5646ce11 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023033011e615bcffc84c248aa29c9c5646ce11 2023-03-30 16:55:20,003 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330977416cd7f2649fcb633a0a738241d19 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230330977416cd7f2649fcb633a0a738241d19 2023-03-30 16:55:20,009 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/3913c04d60f7402093e76fad2160e636 2023-03-30 16:55:20,013 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/084c5e36cd694e1eb0ef071217751eac as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/084c5e36cd694e1eb0ef071217751eac 2023-03-30 16:55:20,016 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/084c5e36cd694e1eb0ef071217751eac, entries=4, sequenceid=13, filesize=5.4 K 2023-03-30 16:55:20,017 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/3913c04d60f7402093e76fad2160e636 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/3913c04d60f7402093e76fad2160e636 2023-03-30 16:55:20,020 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/3913c04d60f7402093e76fad2160e636, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:55:20,021 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 803f43c55f4cd7fc65b94b0eb61debde in 471ms, sequenceid=13, compaction requested=true 2023-03-30 16:55:20,021 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:20,021 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:20,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:20,378 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/a0273b067ea249e9846bfc3cb0a03e87 2023-03-30 16:55:20,392 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033050d303d748a7406c8a2312e69834535d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023033050d303d748a7406c8a2312e69834535d 2023-03-30 16:55:20,403 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/c5582be26295411f9a0b7058f0328a1f 2023-03-30 16:55:20,797 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/736101711d9043238deebdbcba7416cf 2023-03-30 16:55:20,802 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/a0273b067ea249e9846bfc3cb0a03e87 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/a0273b067ea249e9846bfc3cb0a03e87 2023-03-30 16:55:20,805 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/a0273b067ea249e9846bfc3cb0a03e87, entries=4, sequenceid=13, filesize=5.4 K 2023-03-30 16:55:20,806 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/736101711d9043238deebdbcba7416cf as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/736101711d9043238deebdbcba7416cf 2023-03-30 16:55:20,810 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/736101711d9043238deebdbcba7416cf, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:55:20,811 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d3e85d08c9236402a775ce01ab813cef in 1260ms, sequenceid=13, compaction requested=true 2023-03-30 16:55:20,811 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:20,811 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:20,811 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:20,816 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330dc6e973904124af598ff79452ded61f8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230330dc6e973904124af598ff79452ded61f8 2023-03-30 16:55:21,221 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/90d4bfc7bcae415fae41c849a28fc3cc 2023-03-30 16:55:21,225 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/c5582be26295411f9a0b7058f0328a1f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/c5582be26295411f9a0b7058f0328a1f 2023-03-30 16:55:21,229 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/c5582be26295411f9a0b7058f0328a1f, entries=4, sequenceid=13, filesize=5.4 K 2023-03-30 16:55:21,230 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/90d4bfc7bcae415fae41c849a28fc3cc as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/90d4bfc7bcae415fae41c849a28fc3cc 2023-03-30 16:55:21,234 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/90d4bfc7bcae415fae41c849a28fc3cc, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:55:21,235 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9cc307f3f7cba7ac9b36daf0f32feb92 in 1684ms, sequenceid=13, compaction requested=true 2023-03-30 16:55:21,235 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:21,235 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-30 16:55:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-30 16:55:21,237 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,237 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:21,238 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,238 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:21,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-30 16:55:21,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27879344[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:21,239 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-30 16:55:21,239 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,241 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,241 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-30 16:55:21,241 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-30 16:55:21,241 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:21,241 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,241 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-30 16:55:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:21,242 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-30 16:55:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:21,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:21,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:21,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:21,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-30 16:55:21,245 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-30 16:55:21,245 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:21,245 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:21,245 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-30 16:55:21,245 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:21,248 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,248 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,248 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:21,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:21,249 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:21,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:21,250 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,252 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:21,252 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-30 16:55:21,252 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:21,252 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:21,253 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:21,253 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:21,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-30 16:55:21,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:21,353 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:21,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:21,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:21,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:21,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:21,358 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:21,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:21,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-30 16:55:21,361 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-30 16:55:21,361 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:21,361 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-30 16:55:21,361 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-30 16:55:21,361 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,361 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:21,365 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:21,365 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:21,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:21,365 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:21,365 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:21,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:21,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:21,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:21,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:21,366 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-30 16:55:21,367 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-30 16:55:21,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-30 16:55:21,367 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-30 16:55:21,367 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:21,367 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-30 16:55:21,367 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:21,367 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. started... 2023-03-30 16:55:21,367 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3e85d08c9236402a775ce01ab813cef 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:55:21,368 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:21,368 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. started... 2023-03-30 16:55:21,368 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 803f43c55f4cd7fc65b94b0eb61debde 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:55:21,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:21,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:21,369 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:21,369 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. started... 2023-03-30 16:55:21,369 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9cc307f3f7cba7ac9b36daf0f32feb92 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:55:21,405 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330fc28bdaf48514ff6a0dc848162a2a0ac to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230330fc28bdaf48514ff6a0dc848162a2a0ac 2023-03-30 16:55:21,405 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033017e1e31ee2e74cf788c380f628c07ad0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023033017e1e31ee2e74cf788c380f628c07ad0 2023-03-30 16:55:21,419 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/571d7e65c94141ea9e22f752ddf90153 2023-03-30 16:55:21,801 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033097d00ba6a14749ceb15e0330d8e20af5 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023033097d00ba6a14749ceb15e0330d8e20af5 2023-03-30 16:55:21,818 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/d3958e16ae0f426eb2fd20f302e05888 2023-03-30 16:55:21,831 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303301b718fb1fc7445e584f112c029eef56f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303301b718fb1fc7445e584f112c029eef56f 2023-03-30 16:55:21,836 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/74a41830b376409882f2c25b3680af8f 2023-03-30 16:55:21,839 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033060c7e6de259541c19162504cc6979fb0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023033060c7e6de259541c19162504cc6979fb0 2023-03-30 16:55:21,842 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/d3958e16ae0f426eb2fd20f302e05888 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/d3958e16ae0f426eb2fd20f302e05888 2023-03-30 16:55:21,844 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/99ef8f709e48459aa0e7206adb65f64a 2023-03-30 16:55:21,847 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/d3958e16ae0f426eb2fd20f302e05888, entries=4, sequenceid=17, filesize=5.4 K 2023-03-30 16:55:21,848 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/74a41830b376409882f2c25b3680af8f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/74a41830b376409882f2c25b3680af8f 2023-03-30 16:55:21,848 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/571d7e65c94141ea9e22f752ddf90153 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/571d7e65c94141ea9e22f752ddf90153 2023-03-30 16:55:21,853 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/571d7e65c94141ea9e22f752ddf90153, entries=4, sequenceid=17, filesize=5.4 K 2023-03-30 16:55:21,854 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/74a41830b376409882f2c25b3680af8f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:55:21,854 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/99ef8f709e48459aa0e7206adb65f64a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/99ef8f709e48459aa0e7206adb65f64a 2023-03-30 16:55:21,855 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9cc307f3f7cba7ac9b36daf0f32feb92 in 486ms, sequenceid=17, compaction requested=true 2023-03-30 16:55:21,855 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:21,855 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:21,855 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:21,860 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/99ef8f709e48459aa0e7206adb65f64a, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:55:21,862 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 803f43c55f4cd7fc65b94b0eb61debde in 494ms, sequenceid=17, compaction requested=true 2023-03-30 16:55:21,862 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:21,862 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:21,862 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:22,207 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/33d5f5de9de74d5ba6f7d8a24722093d 2023-03-30 16:55:22,622 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330219223600e6f4d188f0da5a7c5305766 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230330219223600e6f4d188f0da5a7c5305766 2023-03-30 16:55:23,027 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/16dd58642be74d529905dc8cff71ac7e 2023-03-30 16:55:23,031 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/33d5f5de9de74d5ba6f7d8a24722093d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/33d5f5de9de74d5ba6f7d8a24722093d 2023-03-30 16:55:23,035 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/33d5f5de9de74d5ba6f7d8a24722093d, entries=4, sequenceid=17, filesize=5.4 K 2023-03-30 16:55:23,036 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/16dd58642be74d529905dc8cff71ac7e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/16dd58642be74d529905dc8cff71ac7e 2023-03-30 16:55:23,040 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/16dd58642be74d529905dc8cff71ac7e, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:55:23,040 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d3e85d08c9236402a775ce01ab813cef in 1673ms, sequenceid=17, compaction requested=true 2023-03-30 16:55:23,041 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:23,041 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:23,041 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:23,041 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:23,041 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,041 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-30 16:55:23,041 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-30 16:55:23,042 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,042 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:23,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:23,044 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:23,044 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:23,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:23,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-30 16:55:23,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f7d70e[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:23,045 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-30 16:55:23,045 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,046 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-30 16:55:23,046 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-30 16:55:23,046 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:23,046 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,047 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-30 16:55:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:23,048 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-30 16:55:23,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:23,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:23,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:23,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-30 16:55:23,051 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-30 16:55:23,051 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:23,051 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:23,051 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-30 16:55:23,051 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:23,052 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,052 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,052 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:23,053 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:23,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:23,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:23,054 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:23,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:23,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,056 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,056 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:23,056 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:23,056 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:23,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:23,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:23,056 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:23,057 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,057 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,057 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:23,057 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:23,057 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-30 16:55:23,057 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:23,057 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,057 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:23,057 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:23,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-30 16:55:23,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:23,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:23,157 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:23,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:23,166 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:23,173 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:23,183 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:23,184 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:23,228 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:23,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:23,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-30 16:55:23,230 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-30 16:55:23,231 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:23,231 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-30 16:55:23,231 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-30 16:55:23,231 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,231 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:23,233 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:23,233 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:23,233 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:23,233 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:23,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:23,234 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-30 16:55:23,234 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-30 16:55:23,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-30 16:55:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-30 16:55:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-30 16:55:23,235 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:23,235 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. started... 2023-03-30 16:55:23,235 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d3e85d08c9236402a775ce01ab813cef 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:55:23,240 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:23,240 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. started... 2023-03-30 16:55:23,240 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 803f43c55f4cd7fc65b94b0eb61debde 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:55:23,244 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:23,244 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:23,244 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:23,244 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. started... 2023-03-30 16:55:23,244 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9cc307f3f7cba7ac9b36daf0f32feb92 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:55:23,688 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/466753fc769e4d1b9a93cd07b2126617 2023-03-30 16:55:23,692 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 466753fc769e4d1b9a93cd07b2126617 2023-03-30 16:55:23,708 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/d2a078accb094cf2a5467e3af00d3c0f 2023-03-30 16:55:23,711 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2a078accb094cf2a5467e3af00d3c0f 2023-03-30 16:55:23,712 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/466753fc769e4d1b9a93cd07b2126617 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/466753fc769e4d1b9a93cd07b2126617 2023-03-30 16:55:23,717 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 466753fc769e4d1b9a93cd07b2126617 2023-03-30 16:55:23,717 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/466753fc769e4d1b9a93cd07b2126617, entries=3, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:23,718 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/d2a078accb094cf2a5467e3af00d3c0f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/d2a078accb094cf2a5467e3af00d3c0f 2023-03-30 16:55:23,725 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2a078accb094cf2a5467e3af00d3c0f 2023-03-30 16:55:23,725 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/d2a078accb094cf2a5467e3af00d3c0f, entries=1, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:23,726 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9cc307f3f7cba7ac9b36daf0f32feb92 in 482ms, sequenceid=23, compaction requested=true 2023-03-30 16:55:23,726 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:23,726 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:23,726 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:24,073 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/e0ec746f618c4e448d72b62e27c0ed3c 2023-03-30 16:55:24,078 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0ec746f618c4e448d72b62e27c0ed3c 2023-03-30 16:55:24,081 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/cde3d7928719440f9e4d56f73773aca7 2023-03-30 16:55:24,086 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cde3d7928719440f9e4d56f73773aca7 2023-03-30 16:55:24,124 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/519e96e1c38d4635a891fd76e5552998 2023-03-30 16:55:24,128 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 519e96e1c38d4635a891fd76e5552998 2023-03-30 16:55:24,128 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/e0ec746f618c4e448d72b62e27c0ed3c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/e0ec746f618c4e448d72b62e27c0ed3c 2023-03-30 16:55:24,132 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0ec746f618c4e448d72b62e27c0ed3c 2023-03-30 16:55:24,132 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/e0ec746f618c4e448d72b62e27c0ed3c, entries=3, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:24,133 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/519e96e1c38d4635a891fd76e5552998 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/519e96e1c38d4635a891fd76e5552998 2023-03-30 16:55:24,141 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 519e96e1c38d4635a891fd76e5552998 2023-03-30 16:55:24,141 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/519e96e1c38d4635a891fd76e5552998, entries=1, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:24,142 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d3e85d08c9236402a775ce01ab813cef in 907ms, sequenceid=23, compaction requested=true 2023-03-30 16:55:24,142 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:24,142 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:24,142 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:24,527 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/bfff12c06ad74a6abbf676fc220b023d 2023-03-30 16:55:24,531 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfff12c06ad74a6abbf676fc220b023d 2023-03-30 16:55:24,532 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/cde3d7928719440f9e4d56f73773aca7 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/cde3d7928719440f9e4d56f73773aca7 2023-03-30 16:55:24,539 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cde3d7928719440f9e4d56f73773aca7 2023-03-30 16:55:24,539 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/cde3d7928719440f9e4d56f73773aca7, entries=3, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:24,540 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/bfff12c06ad74a6abbf676fc220b023d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/bfff12c06ad74a6abbf676fc220b023d 2023-03-30 16:55:24,549 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfff12c06ad74a6abbf676fc220b023d 2023-03-30 16:55:24,549 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/bfff12c06ad74a6abbf676fc220b023d, entries=1, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:24,550 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 803f43c55f4cd7fc65b94b0eb61debde in 1310ms, sequenceid=23, compaction requested=true 2023-03-30 16:55:24,550 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:24,550 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,551 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-30 16:55:24,551 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-30 16:55:24,552 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,552 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:24,552 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,553 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:24,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-30 16:55:24,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b74b92e[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:24,554 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-30 16:55:24,554 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,556 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,556 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-30 16:55:24,556 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-30 16:55:24,556 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:24,556 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,556 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:24,563 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-30 16:55:24,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:24,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:24,563 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-30 16:55:24,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:24,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-30 16:55:24,566 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-30 16:55:24,566 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:24,566 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:24,566 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-30 16:55:24,566 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:24,568 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:24,568 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:24,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:24,568 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:24,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:24,568 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:24,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,570 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:24,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-30 16:55:24,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,572 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,572 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:24,572 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:24,572 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-30 16:55:24,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:24,572 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-30 16:55:24,572 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:24,572 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:24,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:24,572 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:24,572 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:24,573 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,573 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-30 16:55:24,573 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:24,573 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:24,573 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-30 16:55:24,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:24,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:24,673 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:24,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:24,674 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:24,674 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): d3e85d08c9236402a775ce01ab813cef/family1 is initiating major compaction (all files) 2023-03-30 16:55:24,675 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:24,675 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:24,675 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of d3e85d08c9236402a775ce01ab813cef/family1 in ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:24,675 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/652230c16363487e9a52d55505f5ddde, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/5d0db43b9f334e25805be702b3d75766, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/a0273b067ea249e9846bfc3cb0a03e87, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/33d5f5de9de74d5ba6f7d8a24722093d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/e0ec746f618c4e448d72b62e27c0ed3c] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp, totalSize=26.6 K 2023-03-30 16:55:24,676 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 652230c16363487e9a52d55505f5ddde, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195316650 2023-03-30 16:55:24,676 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 5d0db43b9f334e25805be702b3d75766, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195318093 2023-03-30 16:55:24,677 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting a0273b067ea249e9846bfc3cb0a03e87, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195319534 2023-03-30 16:55:24,677 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 33d5f5de9de74d5ba6f7d8a24722093d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195321355 2023-03-30 16:55:24,677 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting e0ec746f618c4e448d72b62e27c0ed3c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:24,689 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): d3e85d08c9236402a775ce01ab813cef#family1#compaction#150 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:24,696 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230330a80110b0fca74b27b743ae9e88a05baf_del 2023-03-30 16:55:24,696 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330a80110b0fca74b27b743ae9e88a05baf_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230330a80110b0fca74b27b743ae9e88a05baf_del 2023-03-30 16:55:25,514 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd554057ab474556991d37ab39f39db5 2023-03-30 16:55:25,515 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family1/dd554057ab474556991d37ab39f39db5 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/dd554057ab474556991d37ab39f39db5 2023-03-30 16:55:25,517 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd554057ab474556991d37ab39f39db5 2023-03-30 16:55:25,518 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d3e85d08c9236402a775ce01ab813cef/family1 of d3e85d08c9236402a775ce01ab813cef into dd554057ab474556991d37ab39f39db5(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:25,518 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:25,518 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:25,518 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): d3e85d08c9236402a775ce01ab813cef/family2 is initiating major compaction (all files) 2023-03-30 16:55:25,519 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:25,519 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:25,519 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of d3e85d08c9236402a775ce01ab813cef/family2 in ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:25,519 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/2e1a4bd669224d008b8daab567623663, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/b51ffbd035164d4895355c56373e9478, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/736101711d9043238deebdbcba7416cf, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/16dd58642be74d529905dc8cff71ac7e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/519e96e1c38d4635a891fd76e5552998] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp, totalSize=25.3 K 2023-03-30 16:55:25,520 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 2e1a4bd669224d008b8daab567623663, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195316650 2023-03-30 16:55:25,520 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting b51ffbd035164d4895355c56373e9478, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195318093 2023-03-30 16:55:25,520 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 736101711d9043238deebdbcba7416cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195319534 2023-03-30 16:55:25,521 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 16dd58642be74d529905dc8cff71ac7e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195321355 2023-03-30 16:55:25,521 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 519e96e1c38d4635a891fd76e5552998, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:25,528 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): d3e85d08c9236402a775ce01ab813cef#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:25,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/652230c16363487e9a52d55505f5ddde, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/5d0db43b9f334e25805be702b3d75766, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/a0273b067ea249e9846bfc3cb0a03e87, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/33d5f5de9de74d5ba6f7d8a24722093d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/e0ec746f618c4e448d72b62e27c0ed3c] to archive 2023-03-30 16:55:25,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:25,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/652230c16363487e9a52d55505f5ddde to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/652230c16363487e9a52d55505f5ddde 2023-03-30 16:55:25,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/5d0db43b9f334e25805be702b3d75766 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/5d0db43b9f334e25805be702b3d75766 2023-03-30 16:55:25,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/a0273b067ea249e9846bfc3cb0a03e87 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/a0273b067ea249e9846bfc3cb0a03e87 2023-03-30 16:55:25,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/33d5f5de9de74d5ba6f7d8a24722093d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/33d5f5de9de74d5ba6f7d8a24722093d 2023-03-30 16:55:25,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/e0ec746f618c4e448d72b62e27c0ed3c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/e0ec746f618c4e448d72b62e27c0ed3c 2023-03-30 16:55:25,935 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230330743ec6706471445a825c204dd5653eb7_del 2023-03-30 16:55:25,936 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330743ec6706471445a825c204dd5653eb7_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230330743ec6706471445a825c204dd5653eb7_del 2023-03-30 16:55:26,748 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1abd5da0edf4df2bb5758f36dffb7cd 2023-03-30 16:55:26,749 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/.tmp/family2/f1abd5da0edf4df2bb5758f36dffb7cd as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/f1abd5da0edf4df2bb5758f36dffb7cd 2023-03-30 16:55:26,751 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1abd5da0edf4df2bb5758f36dffb7cd 2023-03-30 16:55:26,752 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d3e85d08c9236402a775ce01ab813cef/family2 of d3e85d08c9236402a775ce01ab813cef into f1abd5da0edf4df2bb5758f36dffb7cd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:26,752 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:26,752 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:26,752 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 803f43c55f4cd7fc65b94b0eb61debde/family1 is initiating major compaction (all files) 2023-03-30 16:55:26,753 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:26,753 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:26,753 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 803f43c55f4cd7fc65b94b0eb61debde/family1 in ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:26,753 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/28de491f8a8f45de9a1bc98c4bea3a0c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/7910f7490a2e439ba91056636ce2af32, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/084c5e36cd694e1eb0ef071217751eac, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/571d7e65c94141ea9e22f752ddf90153, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/cde3d7928719440f9e4d56f73773aca7] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp, totalSize=26.6 K 2023-03-30 16:55:26,753 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 28de491f8a8f45de9a1bc98c4bea3a0c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195316649 2023-03-30 16:55:26,754 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 7910f7490a2e439ba91056636ce2af32, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195318093 2023-03-30 16:55:26,754 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 084c5e36cd694e1eb0ef071217751eac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195319533 2023-03-30 16:55:26,754 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 571d7e65c94141ea9e22f752ddf90153, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195321355 2023-03-30 16:55:26,754 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting cde3d7928719440f9e4d56f73773aca7, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:26,761 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 803f43c55f4cd7fc65b94b0eb61debde#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:26,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/2e1a4bd669224d008b8daab567623663, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/b51ffbd035164d4895355c56373e9478, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/736101711d9043238deebdbcba7416cf, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/16dd58642be74d529905dc8cff71ac7e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/519e96e1c38d4635a891fd76e5552998] to archive 2023-03-30 16:55:26,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:26,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/2e1a4bd669224d008b8daab567623663 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/2e1a4bd669224d008b8daab567623663 2023-03-30 16:55:26,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/b51ffbd035164d4895355c56373e9478 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/b51ffbd035164d4895355c56373e9478 2023-03-30 16:55:26,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/736101711d9043238deebdbcba7416cf to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/736101711d9043238deebdbcba7416cf 2023-03-30 16:55:26,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/16dd58642be74d529905dc8cff71ac7e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/16dd58642be74d529905dc8cff71ac7e 2023-03-30 16:55:26,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/519e96e1c38d4635a891fd76e5552998 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family2/519e96e1c38d4635a891fd76e5552998 2023-03-30 16:55:27,168 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303306f369844db84494aa863b7866161b27c_del 2023-03-30 16:55:27,168 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303306f369844db84494aa863b7866161b27c_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303306f369844db84494aa863b7866161b27c_del 2023-03-30 16:55:27,982 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4386c7fa172a49f8a20496ce18b50bf0 2023-03-30 16:55:27,983 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family1/4386c7fa172a49f8a20496ce18b50bf0 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/4386c7fa172a49f8a20496ce18b50bf0 2023-03-30 16:55:27,986 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4386c7fa172a49f8a20496ce18b50bf0 2023-03-30 16:55:27,986 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 803f43c55f4cd7fc65b94b0eb61debde/family1 of 803f43c55f4cd7fc65b94b0eb61debde into 4386c7fa172a49f8a20496ce18b50bf0(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:27,986 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:27,987 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:27,987 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 803f43c55f4cd7fc65b94b0eb61debde/family2 is initiating major compaction (all files) 2023-03-30 16:55:27,987 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:27,987 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:27,987 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 803f43c55f4cd7fc65b94b0eb61debde/family2 in ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:27,987 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/d619c8376a2a4fc6a189c34a3f60ced1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/e86300e1a5a845788a47074ceb32ddd8, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/3913c04d60f7402093e76fad2160e636, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/99ef8f709e48459aa0e7206adb65f64a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/bfff12c06ad74a6abbf676fc220b023d] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp, totalSize=25.3 K 2023-03-30 16:55:27,987 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d619c8376a2a4fc6a189c34a3f60ced1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195316649 2023-03-30 16:55:27,988 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting e86300e1a5a845788a47074ceb32ddd8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195318093 2023-03-30 16:55:27,988 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 3913c04d60f7402093e76fad2160e636, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195319533 2023-03-30 16:55:27,988 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 99ef8f709e48459aa0e7206adb65f64a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195321355 2023-03-30 16:55:27,988 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting bfff12c06ad74a6abbf676fc220b023d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:27,995 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 803f43c55f4cd7fc65b94b0eb61debde#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:28,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/28de491f8a8f45de9a1bc98c4bea3a0c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/7910f7490a2e439ba91056636ce2af32, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/084c5e36cd694e1eb0ef071217751eac, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/571d7e65c94141ea9e22f752ddf90153, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/cde3d7928719440f9e4d56f73773aca7] to archive 2023-03-30 16:55:28,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:28,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/28de491f8a8f45de9a1bc98c4bea3a0c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/28de491f8a8f45de9a1bc98c4bea3a0c 2023-03-30 16:55:28,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/7910f7490a2e439ba91056636ce2af32 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/7910f7490a2e439ba91056636ce2af32 2023-03-30 16:55:28,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/084c5e36cd694e1eb0ef071217751eac to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/084c5e36cd694e1eb0ef071217751eac 2023-03-30 16:55:28,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/571d7e65c94141ea9e22f752ddf90153 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/571d7e65c94141ea9e22f752ddf90153 2023-03-30 16:55:28,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/cde3d7928719440f9e4d56f73773aca7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/cde3d7928719440f9e4d56f73773aca7 2023-03-30 16:55:28,402 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230330b87547f333f948fe8adc1678def52b70_del 2023-03-30 16:55:28,402 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330b87547f333f948fe8adc1678def52b70_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230330b87547f333f948fe8adc1678def52b70_del 2023-03-30 16:55:29,215 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32dc4de140bb4970939902cda8281dc0 2023-03-30 16:55:29,215 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/.tmp/family2/32dc4de140bb4970939902cda8281dc0 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/32dc4de140bb4970939902cda8281dc0 2023-03-30 16:55:29,219 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32dc4de140bb4970939902cda8281dc0 2023-03-30 16:55:29,219 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 803f43c55f4cd7fc65b94b0eb61debde/family2 of 803f43c55f4cd7fc65b94b0eb61debde into 32dc4de140bb4970939902cda8281dc0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:29,220 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:29,220 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:29,220 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 9cc307f3f7cba7ac9b36daf0f32feb92/family1 is initiating major compaction (all files) 2023-03-30 16:55:29,220 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:29,220 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:29,220 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 9cc307f3f7cba7ac9b36daf0f32feb92/family1 in ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:29,220 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/56c39ca850224adc89a5ef4ab9e2e17a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/f9a2e674bb174b5da506f51b9bb92ee0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/c5582be26295411f9a0b7058f0328a1f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/d3958e16ae0f426eb2fd20f302e05888, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/466753fc769e4d1b9a93cd07b2126617] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp, totalSize=26.6 K 2023-03-30 16:55:29,221 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 56c39ca850224adc89a5ef4ab9e2e17a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195316651 2023-03-30 16:55:29,221 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting f9a2e674bb174b5da506f51b9bb92ee0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195318093 2023-03-30 16:55:29,221 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting c5582be26295411f9a0b7058f0328a1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195319534 2023-03-30 16:55:29,221 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d3958e16ae0f426eb2fd20f302e05888, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195321355 2023-03-30 16:55:29,222 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 466753fc769e4d1b9a93cd07b2126617, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:29,230 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 9cc307f3f7cba7ac9b36daf0f32feb92#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:29,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/d619c8376a2a4fc6a189c34a3f60ced1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/e86300e1a5a845788a47074ceb32ddd8, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/3913c04d60f7402093e76fad2160e636, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/99ef8f709e48459aa0e7206adb65f64a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/bfff12c06ad74a6abbf676fc220b023d] to archive 2023-03-30 16:55:29,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:29,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/d619c8376a2a4fc6a189c34a3f60ced1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/d619c8376a2a4fc6a189c34a3f60ced1 2023-03-30 16:55:29,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/e86300e1a5a845788a47074ceb32ddd8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/e86300e1a5a845788a47074ceb32ddd8 2023-03-30 16:55:29,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/3913c04d60f7402093e76fad2160e636 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/3913c04d60f7402093e76fad2160e636 2023-03-30 16:55:29,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/99ef8f709e48459aa0e7206adb65f64a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/99ef8f709e48459aa0e7206adb65f64a 2023-03-30 16:55:29,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/bfff12c06ad74a6abbf676fc220b023d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family2/bfff12c06ad74a6abbf676fc220b023d 2023-03-30 16:55:29,637 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303302a9b9661edbf4c09ad112d869476b6e1_del 2023-03-30 16:55:29,637 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303302a9b9661edbf4c09ad112d869476b6e1_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303302a9b9661edbf4c09ad112d869476b6e1_del 2023-03-30 16:55:30,450 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 802815b24e8749b18cfae444f000ca55 2023-03-30 16:55:30,451 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family1/802815b24e8749b18cfae444f000ca55 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/802815b24e8749b18cfae444f000ca55 2023-03-30 16:55:30,455 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 802815b24e8749b18cfae444f000ca55 2023-03-30 16:55:30,455 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9cc307f3f7cba7ac9b36daf0f32feb92/family1 of 9cc307f3f7cba7ac9b36daf0f32feb92 into 802815b24e8749b18cfae444f000ca55(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:30,456 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:30,456 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:30,456 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 9cc307f3f7cba7ac9b36daf0f32feb92/family2 is initiating major compaction (all files) 2023-03-30 16:55:30,456 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:30,456 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:30,458 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 9cc307f3f7cba7ac9b36daf0f32feb92/family2 in ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:30,458 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/76f4db601a574f5b87ec598db04b577b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/a8c481ebf5a343d8874aab2c468d7760, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/90d4bfc7bcae415fae41c849a28fc3cc, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/74a41830b376409882f2c25b3680af8f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/d2a078accb094cf2a5467e3af00d3c0f] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp, totalSize=25.3 K 2023-03-30 16:55:30,458 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 76f4db601a574f5b87ec598db04b577b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195316651 2023-03-30 16:55:30,459 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting a8c481ebf5a343d8874aab2c468d7760, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195318093 2023-03-30 16:55:30,459 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 90d4bfc7bcae415fae41c849a28fc3cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195319534 2023-03-30 16:55:30,459 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 74a41830b376409882f2c25b3680af8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195321355 2023-03-30 16:55:30,459 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d2a078accb094cf2a5467e3af00d3c0f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:30,467 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 9cc307f3f7cba7ac9b36daf0f32feb92#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:30,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/56c39ca850224adc89a5ef4ab9e2e17a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/f9a2e674bb174b5da506f51b9bb92ee0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/c5582be26295411f9a0b7058f0328a1f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/d3958e16ae0f426eb2fd20f302e05888, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/466753fc769e4d1b9a93cd07b2126617] to archive 2023-03-30 16:55:30,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:30,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/56c39ca850224adc89a5ef4ab9e2e17a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/56c39ca850224adc89a5ef4ab9e2e17a 2023-03-30 16:55:30,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/f9a2e674bb174b5da506f51b9bb92ee0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/f9a2e674bb174b5da506f51b9bb92ee0 2023-03-30 16:55:30,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/c5582be26295411f9a0b7058f0328a1f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/c5582be26295411f9a0b7058f0328a1f 2023-03-30 16:55:30,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/d3958e16ae0f426eb2fd20f302e05888 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/d3958e16ae0f426eb2fd20f302e05888 2023-03-30 16:55:30,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/466753fc769e4d1b9a93cd07b2126617 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/466753fc769e4d1b9a93cd07b2126617 2023-03-30 16:55:30,876 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303302166d399bebe435d9b31c973e153a351_del 2023-03-30 16:55:30,876 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303302166d399bebe435d9b31c973e153a351_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303302166d399bebe435d9b31c973e153a351_del 2023-03-30 16:55:31,689 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14c819398e9c4d88bd23180c4cb34092 2023-03-30 16:55:31,690 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/.tmp/family2/14c819398e9c4d88bd23180c4cb34092 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/14c819398e9c4d88bd23180c4cb34092 2023-03-30 16:55:31,693 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14c819398e9c4d88bd23180c4cb34092 2023-03-30 16:55:31,694 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9cc307f3f7cba7ac9b36daf0f32feb92/family2 of 9cc307f3f7cba7ac9b36daf0f32feb92 into 14c819398e9c4d88bd23180c4cb34092(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:31,694 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:31,697 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:31,699 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:31,702 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:31,702 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:31,706 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-30 16:55:31,717 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-30 16:55:31,720 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303306f369844db84494aa863b7866161b27c_del 2023-03-30 16:55:31,722 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230330a80110b0fca74b27b743ae9e88a05baf_del 2023-03-30 16:55:31,724 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303302a9b9661edbf4c09ad112d869476b6e1_del 2023-03-30 16:55:31,724 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:31,725 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(139): Connect 0x5317d3f9 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:55:31,729 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b6f7af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:55:31,730 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230330 for table='ns:testMinorCompaction' and column='family1' 2023-03-30 16:55:31,730 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230330 for table='ns:testMinorCompaction' and column='family1' 2023-03-30 16:55:31,730 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230330 for table='ns:testMinorCompaction' and column='family1' 2023-03-30 16:55:31,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/76f4db601a574f5b87ec598db04b577b, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/a8c481ebf5a343d8874aab2c468d7760, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/90d4bfc7bcae415fae41c849a28fc3cc, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/74a41830b376409882f2c25b3680af8f, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/d2a078accb094cf2a5467e3af00d3c0f] to archive 2023-03-30 16:55:31,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:31,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/76f4db601a574f5b87ec598db04b577b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/76f4db601a574f5b87ec598db04b577b 2023-03-30 16:55:31,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/a8c481ebf5a343d8874aab2c468d7760 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/a8c481ebf5a343d8874aab2c468d7760 2023-03-30 16:55:31,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/90d4bfc7bcae415fae41c849a28fc3cc to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/90d4bfc7bcae415fae41c849a28fc3cc 2023-03-30 16:55:31,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/74a41830b376409882f2c25b3680af8f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/74a41830b376409882f2c25b3680af8f 2023-03-30 16:55:31,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/d2a078accb094cf2a5467e3af00d3c0f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family2/d2a078accb094cf2a5467e3af00d3c0f 2023-03-30 16:55:32,553 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330f51e6956a4744556a790347472d99fed to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230330f51e6956a4744556a790347472d99fed 2023-03-30 16:55:32,554 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330059eb74ebeed463b87a7b66ce3de6cb5 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230330059eb74ebeed463b87a7b66ce3de6cb5 2023-03-30 16:55:32,554 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:32,554 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:32,559 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330f4815399d379412f9b9ce0274525351b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230330f4815399d379412f9b9ce0274525351b 2023-03-30 16:55:32,560 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:32,572 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:55:32,575 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50560, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:55:32,580 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:55:32,582 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:55:32,595 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230330/family1/9c6a116036f546c587742e272f0fffb7 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-30 16:55:32,596 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230330/family1/9c6a116036f546c587742e272f0fffb7}] 2023-03-30 16:55:32,596 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/family1/1935afd771054753899185ee65816841 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-30 16:55:32,596 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/family1/1935afd771054753899185ee65816841}] 2023-03-30 16:55:32,597 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230330/family1/d13a5d0489504158b271f1bf97d23c08 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-30 16:55:32,598 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230330/family1/d13a5d0489504158b271f1bf97d23c08}] 2023-03-30 16:55:32,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230330/family1/d13a5d0489504158b271f1bf97d23c08 for inclusion in d3e85d08c9236402a775ce01ab813cef/family1 2023-03-30 16:55:32,602 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230330/family1/9c6a116036f546c587742e272f0fffb7 for inclusion in 9cc307f3f7cba7ac9b36daf0f32feb92/family1 2023-03-30 16:55:32,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/family1/1935afd771054753899185ee65816841 for inclusion in 803f43c55f4cd7fc65b94b0eb61debde/family1 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last=1 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:32,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230330/family1/1935afd771054753899185ee65816841 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__43ahs4u1odbfla177bqfga4jgkn68ai4ejgmkbpbos4ppsdh22no6dlropci1ptt/family1/1935afd771054753899185ee65816841 2023-03-30 16:55:32,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230330/family1/d13a5d0489504158b271f1bf97d23c08 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__lqhdf6275eg8vhkauphhkhmptgb143amjdhkv2chpfvls5p75p661it0saq9ofki/family1/d13a5d0489504158b271f1bf97d23c08 2023-03-30 16:55:32,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230330/family1/9c6a116036f546c587742e272f0fffb7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__95blg8010bg6s8ksn7hg1a7itgvvjiekqcimln2uv7dpt0q1rj0ckgf3scq84kdp/family1/9c6a116036f546c587742e272f0fffb7 2023-03-30 16:55:32,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__43ahs4u1odbfla177bqfga4jgkn68ai4ejgmkbpbos4ppsdh22no6dlropci1ptt/family1/1935afd771054753899185ee65816841 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/f91d6c5a91494f53ae0dc3ee033ce16e_SeqId_28_ 2023-03-30 16:55:32,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__lqhdf6275eg8vhkauphhkhmptgb143amjdhkv2chpfvls5p75p661it0saq9ofki/family1/d13a5d0489504158b271f1bf97d23c08 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/909acd7e9e1d42bd998e168157830ebc_SeqId_28_ 2023-03-30 16:55:32,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__95blg8010bg6s8ksn7hg1a7itgvvjiekqcimln2uv7dpt0q1rj0ckgf3scq84kdp/family1/9c6a116036f546c587742e272f0fffb7 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/e17bac63be2e4624a6b2c3d7c3998b6d_SeqId_28_ 2023-03-30 16:55:32,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__43ahs4u1odbfla177bqfga4jgkn68ai4ejgmkbpbos4ppsdh22no6dlropci1ptt/family1/1935afd771054753899185ee65816841 into 803f43c55f4cd7fc65b94b0eb61debde/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/f91d6c5a91494f53ae0dc3ee033ce16e_SeqId_28_ - updating store file list. 2023-03-30 16:55:32,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__lqhdf6275eg8vhkauphhkhmptgb143amjdhkv2chpfvls5p75p661it0saq9ofki/family1/d13a5d0489504158b271f1bf97d23c08 into d3e85d08c9236402a775ce01ab813cef/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/909acd7e9e1d42bd998e168157830ebc_SeqId_28_ - updating store file list. 2023-03-30 16:55:32,607 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__95blg8010bg6s8ksn7hg1a7itgvvjiekqcimln2uv7dpt0q1rj0ckgf3scq84kdp/family1/9c6a116036f546c587742e272f0fffb7 into 9cc307f3f7cba7ac9b36daf0f32feb92/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/e17bac63be2e4624a6b2c3d7c3998b6d_SeqId_28_ - updating store file list. 2023-03-30 16:55:32,610 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/f91d6c5a91494f53ae0dc3ee033ce16e_SeqId_28_ into 803f43c55f4cd7fc65b94b0eb61debde/family1 2023-03-30 16:55:32,610 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__43ahs4u1odbfla177bqfga4jgkn68ai4ejgmkbpbos4ppsdh22no6dlropci1ptt/family1/1935afd771054753899185ee65816841 into 803f43c55f4cd7fc65b94b0eb61debde/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/family1/f91d6c5a91494f53ae0dc3ee033ce16e_SeqId_28_) 2023-03-30 16:55:32,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/909acd7e9e1d42bd998e168157830ebc_SeqId_28_ into d3e85d08c9236402a775ce01ab813cef/family1 2023-03-30 16:55:32,610 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/e17bac63be2e4624a6b2c3d7c3998b6d_SeqId_28_ into 9cc307f3f7cba7ac9b36daf0f32feb92/family1 2023-03-30 16:55:32,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__lqhdf6275eg8vhkauphhkhmptgb143amjdhkv2chpfvls5p75p661it0saq9ofki/family1/d13a5d0489504158b271f1bf97d23c08 into d3e85d08c9236402a775ce01ab813cef/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/family1/909acd7e9e1d42bd998e168157830ebc_SeqId_28_) 2023-03-30 16:55:32,610 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__95blg8010bg6s8ksn7hg1a7itgvvjiekqcimln2uv7dpt0q1rj0ckgf3scq84kdp/family1/9c6a116036f546c587742e272f0fffb7 into 9cc307f3f7cba7ac9b36daf0f32feb92/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/family1/e17bac63be2e4624a6b2c3d7c3998b6d_SeqId_28_) 2023-03-30 16:55:32,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__43ahs4u1odbfla177bqfga4jgkn68ai4ejgmkbpbos4ppsdh22no6dlropci1ptt/family1/1935afd771054753899185ee65816841 2023-03-30 16:55:32,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__lqhdf6275eg8vhkauphhkhmptgb143amjdhkv2chpfvls5p75p661it0saq9ofki/family1/d13a5d0489504158b271f1bf97d23c08 2023-03-30 16:55:32,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__ns_testMinorCompaction__95blg8010bg6s8ksn7hg1a7itgvvjiekqcimln2uv7dpt0q1rj0ckgf3scq84kdp/family1/9c6a116036f546c587742e272f0fffb7 2023-03-30 16:55:32,612 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:32,612 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:32,612 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:32,613 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:32,613 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:32,613 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:32,614 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230330703119fb7ca84b87ae1fd659a41e6321 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230330703119fb7ca84b87ae1fd659a41e6321 2023-03-30 16:55:32,614 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-30 16:55:32,614 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023033028b67918edd24125abf52462707b851f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023033028b67918edd24125abf52462707b851f 2023-03-30 16:55:32,614 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023033066850a3ad13540e0846620c617afd1b2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023033066850a3ad13540e0846620c617afd1b2 2023-03-30 16:55:32,614 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230330' 2023-03-30 16:55:32,614 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-30 16:55:32,614 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230330' 2023-03-30 16:55:32,614 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-30 16:55:32,614 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230330' 2023-03-30 16:55:32,615 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230330 for table='ns:testMinorCompaction' and column='family1' 2023-03-30 16:55:32,615 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230330 for table='ns:testMinorCompaction' and column='family1' 2023-03-30 16:55:32,615 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230330 for table='ns:testMinorCompaction' and column='family1' 2023-03-30 16:55:32,615 INFO [Listener at localhost/41799] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-30 16:55:32,617 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:32,619 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:32,621 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:32,622 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:32,641 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 278), OpenFileDescriptor=632 (was 695), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=397 (was 420), ProcessCount=169 (was 169), AvailableMemoryMB=4354 (was 4382) 2023-03-30 16:55:32,656 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=397, ProcessCount=169, AvailableMemoryMB=4354 2023-03-30 16:55:32,659 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-30 16:55:32,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:32,661 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:55:32,661 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-30 16:55:32,661 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:55:32,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-30 16:55:32,662 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:32,663 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3 empty. 2023-03-30 16:55:32,663 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:32,663 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-30 16:55:32,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-30 16:55:32,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-30 16:55:33,070 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-30 16:55:33,072 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f23fa6fb2a6b590b388346ecbb7010d3, NAME => 'testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:55:33,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-30 16:55:33,476 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:33,476 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing f23fa6fb2a6b590b388346ecbb7010d3, disabling compactions & flushes 2023-03-30 16:55:33,476 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:33,476 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:33,477 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. after waiting 0 ms 2023-03-30 16:55:33,477 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:33,477 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:33,477 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:33,478 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:55:33,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680195333479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195333479"}]},"ts":"1680195333479"} 2023-03-30 16:55:33,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-30 16:55:33,481 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:55:33,481 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195333481"}]},"ts":"1680195333481"} 2023-03-30 16:55:33,482 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-30 16:55:33,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f23fa6fb2a6b590b388346ecbb7010d3, ASSIGN}] 2023-03-30 16:55:33,486 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f23fa6fb2a6b590b388346ecbb7010d3, ASSIGN 2023-03-30 16:55:33,487 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f23fa6fb2a6b590b388346ecbb7010d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:55:33,638 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f23fa6fb2a6b590b388346ecbb7010d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:33,638 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680195333638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195333638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195333638"}]},"ts":"1680195333638"} 2023-03-30 16:55:33,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure f23fa6fb2a6b590b388346ecbb7010d3, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:33,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-30 16:55:33,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:33,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f23fa6fb2a6b590b388346ecbb7010d3, NAME => 'testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3.', STARTKEY => '', ENDKEY => ''} 2023-03-30 16:55:33,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:33,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:33,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:33,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:33,794 INFO [StoreOpener-f23fa6fb2a6b590b388346ecbb7010d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:33,795 DEBUG [StoreOpener-f23fa6fb2a6b590b388346ecbb7010d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:33,795 DEBUG [StoreOpener-f23fa6fb2a6b590b388346ecbb7010d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:33,796 INFO [StoreOpener-f23fa6fb2a6b590b388346ecbb7010d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f23fa6fb2a6b590b388346ecbb7010d3 columnFamilyName family1 2023-03-30 16:55:33,797 INFO [StoreOpener-f23fa6fb2a6b590b388346ecbb7010d3-1] regionserver.HStore(310): Store=f23fa6fb2a6b590b388346ecbb7010d3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:33,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:33,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:33,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:33,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:55:33,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f23fa6fb2a6b590b388346ecbb7010d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61881277, jitterRate=-0.07789711654186249}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-30 16:55:33,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:33,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3., pid=114, masterSystemTime=1680195333791 2023-03-30 16:55:33,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:33,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:33,803 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f23fa6fb2a6b590b388346ecbb7010d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:33,803 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680195333803"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195333803"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195333803"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195333803"}]},"ts":"1680195333803"} 2023-03-30 16:55:33,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-30 16:55:33,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure f23fa6fb2a6b590b388346ecbb7010d3, server=jenkins-hbase4.apache.org,39029,1680195214375 in 165 msec 2023-03-30 16:55:33,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-30 16:55:33,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f23fa6fb2a6b590b388346ecbb7010d3, ASSIGN in 320 msec 2023-03-30 16:55:33,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:55:33,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195333807"}]},"ts":"1680195333807"} 2023-03-30 16:55:33,808 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-30 16:55:33,810 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:55:33,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1510 sec 2023-03-30 16:55:34,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-30 16:55:34,767 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-30 16:55:34,784 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:34,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,785 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:34,785 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:34,786 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:34,786 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:34,786 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,786 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,787 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:34,787 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:34,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:34,788 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:34,788 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:34,789 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:34,789 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:34,789 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:34,792 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:34,792 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:34,793 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-30 16:55:34,813 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303aa4869203a24f179634883706d8734e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511303aa4869203a24f179634883706d8734e 2023-03-30 16:55:35,216 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/7d96f885b6584ba5a0b2d164718388fa 2023-03-30 16:55:35,219 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/7d96f885b6584ba5a0b2d164718388fa as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7d96f885b6584ba5a0b2d164718388fa 2023-03-30 16:55:35,222 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7d96f885b6584ba5a0b2d164718388fa, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-30 16:55:35,223 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 430ms, sequenceid=5, compaction requested=false 2023-03-30 16:55:35,223 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:35,223 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:35,224 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:35,224 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:35,224 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:35,224 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,224 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:35,224 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:35,225 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,225 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:35,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:35,226 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,226 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:35,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:35,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5529756e[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:35,227 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:35,227 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,228 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:35,228 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,228 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:35,230 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:35,230 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,230 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:35,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:35,231 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:35,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:35,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:35,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:35,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:35,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:35,232 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:35,232 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:35,232 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:35,232 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,233 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:35,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,234 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:35,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:35,234 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,235 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:35,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,237 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,237 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:35,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,238 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:35,238 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:35,238 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:35,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,238 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,338 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:35,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:35,343 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:35,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:35,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,344 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:35,344 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:35,344 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:35,344 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:35,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,345 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,346 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,346 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:35,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:35,346 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:35,346 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,347 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:35,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:35,348 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:35,348 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:35,348 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:35,348 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-30 16:55:35,758 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281f57b00d08a549689d0b5d40f42d625f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281f57b00d08a549689d0b5d40f42d625f 2023-03-30 16:55:36,163 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/2bfc95a73cb64a9881809c927a447555 2023-03-30 16:55:36,167 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/2bfc95a73cb64a9881809c927a447555 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/2bfc95a73cb64a9881809c927a447555 2023-03-30 16:55:36,169 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/2bfc95a73cb64a9881809c927a447555, entries=1, sequenceid=9, filesize=5.0 K 2023-03-30 16:55:36,170 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 822ms, sequenceid=9, compaction requested=false 2023-03-30 16:55:36,170 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:36,170 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:36,170 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:36,170 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:36,170 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,170 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:36,170 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:36,173 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,173 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:36,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:36,173 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,173 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:36,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:36,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4eafd13c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:36,175 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:36,175 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,176 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,176 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:36,176 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:36,176 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:36,176 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,176 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:36,177 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,177 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:36,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:36,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:36,177 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:36,178 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:36,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:36,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:36,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:36,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:36,179 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:36,179 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:36,179 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:36,179 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,179 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:36,181 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,181 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:36,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,181 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:36,181 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:36,182 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:36,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:36,185 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:36,185 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:36,185 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:36,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:36,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:36,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:36,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:36,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:36,185 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,186 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,186 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,186 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,286 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:36,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:36,290 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:36,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:36,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,291 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:36,291 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:36,291 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:36,291 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:36,291 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,292 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,297 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:36,297 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:36,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:36,297 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:36,297 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:36,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:36,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,298 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,298 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:36,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:36,298 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:36,298 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:36,298 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:36,298 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:36,298 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:36,298 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:36,298 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:36,298 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:36,354 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-30 16:55:36,708 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012f3bd1507d104a1f9bf1878d256fdcbe to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012f3bd1507d104a1f9bf1878d256fdcbe 2023-03-30 16:55:37,112 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/a6896c0a0b6f46ac9620b54b884abf69 2023-03-30 16:55:37,116 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/a6896c0a0b6f46ac9620b54b884abf69 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a6896c0a0b6f46ac9620b54b884abf69 2023-03-30 16:55:37,119 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a6896c0a0b6f46ac9620b54b884abf69, entries=1, sequenceid=13, filesize=4.9 K 2023-03-30 16:55:37,120 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 822ms, sequenceid=13, compaction requested=true 2023-03-30 16:55:37,120 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:37,120 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:37,121 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:37,121 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:37,121 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,121 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:37,121 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:37,122 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,122 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:37,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:37,123 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,123 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:37,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:37,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d82040[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:37,124 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:37,124 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,131 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,131 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:37,131 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:37,131 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:37,131 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,131 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:37,133 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:37,133 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,133 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:37,133 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:37,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:37,135 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:37,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:37,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:37,135 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,135 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:37,136 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,136 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:37,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,136 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:37,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:37,137 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,138 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,140 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:37,140 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:37,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,140 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,140 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:37,141 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:37,141 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:37,241 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:37,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:37,245 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:37,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:37,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,247 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:37,247 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:37,247 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:37,247 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:37,247 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,247 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,249 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,249 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:37,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:37,250 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:37,250 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,250 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,251 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:37,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:37,251 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:37,251 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:37,251 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:37,251 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:37,251 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:37,251 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:37,251 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:37,251 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:37,662 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205023a6b41cdd2452293e967a7a40200da to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205023a6b41cdd2452293e967a7a40200da 2023-03-30 16:55:38,067 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/e3c70290a5424cfa8fc7f2c5ca4ca039 2023-03-30 16:55:38,070 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/e3c70290a5424cfa8fc7f2c5ca4ca039 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/e3c70290a5424cfa8fc7f2c5ca4ca039 2023-03-30 16:55:38,073 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/e3c70290a5424cfa8fc7f2c5ca4ca039, entries=1, sequenceid=17, filesize=4.9 K 2023-03-30 16:55:38,074 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 823ms, sequenceid=17, compaction requested=true 2023-03-30 16:55:38,075 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:38,075 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:38,075 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:38,075 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:38,075 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,075 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:38,075 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:38,076 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,076 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:38,077 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,077 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:38,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:38,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:38,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:38,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:38,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@687b4a7c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:38,078 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:38,078 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,079 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,079 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:38,079 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:38,079 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:38,079 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,079 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:38,081 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:38,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:38,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:38,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:38,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:38,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:38,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:38,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:38,083 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:38,083 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:38,083 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:38,083 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,083 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:38,086 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,086 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:38,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,086 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:38,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:38,086 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,087 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,089 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,089 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:38,089 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:38,089 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:38,089 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,089 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:38,089 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,089 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:38,090 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:38,089 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,090 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,090 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,090 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:38,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:38,090 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:38,190 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:38,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:38,194 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:38,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:38,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,196 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:38,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:38,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:38,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:38,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,196 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,197 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,197 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:38,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:38,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:38,198 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:38,198 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:38,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:38,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,198 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,199 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:38,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:38,199 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:38,199 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:38,199 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:38,609 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284afa2c7a0eba41f48fecd3ddeb815cb2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284afa2c7a0eba41f48fecd3ddeb815cb2 2023-03-30 16:55:39,014 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/ab48661dde5b46bcae714894ceab46d0 2023-03-30 16:55:39,017 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/ab48661dde5b46bcae714894ceab46d0 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/ab48661dde5b46bcae714894ceab46d0 2023-03-30 16:55:39,020 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/ab48661dde5b46bcae714894ceab46d0, entries=1, sequenceid=21, filesize=4.9 K 2023-03-30 16:55:39,021 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 822ms, sequenceid=21, compaction requested=true 2023-03-30 16:55:39,021 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:39,021 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:39,023 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,023 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:39,023 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,023 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:39,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:39,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76e7d018[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:39,024 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:39,024 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,027 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:39,027 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,027 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:39,028 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:39,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:39,030 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:39,030 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:39,030 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:39,030 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,030 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:39,031 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,031 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:39,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,031 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:39,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:39,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:39,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:39,032 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,033 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,038 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,038 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:39,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:55:39,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:39,038 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:39,038 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:39,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:39,138 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:39,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:39,143 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,144 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:39,144 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:39,144 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:39,144 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:39,145 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,145 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,146 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,146 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:39,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:39,146 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,146 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,147 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:39,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,147 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:39,147 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:39,147 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:39,148 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:39,148 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:39,148 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:39,148 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:39,148 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:39,331 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:55:39,370 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:55:39,371 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5317d3f9 to 127.0.0.1:64100 2023-03-30 16:55:39,371 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:39,371 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:55:39,371 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x113978af to 127.0.0.1:64100 2023-03-30 16:55:39,371 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:39,560 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231aa7816836ea7447cb31d9b43ea140a47 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa7816836ea7447cb31d9b43ea140a47 2023-03-30 16:55:39,965 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/a7a4b3d7870049139a0871a9cfc73397 2023-03-30 16:55:39,969 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/a7a4b3d7870049139a0871a9cfc73397 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a7a4b3d7870049139a0871a9cfc73397 2023-03-30 16:55:39,972 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a7a4b3d7870049139a0871a9cfc73397, entries=1, sequenceid=25, filesize=4.9 K 2023-03-30 16:55:39,973 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 825ms, sequenceid=25, compaction requested=true 2023-03-30 16:55:39,973 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:39,973 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:39,975 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,975 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:39,975 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,975 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:39,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:39,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4671d9c9[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:39,977 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:39,977 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,978 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,978 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:39,978 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:39,978 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,978 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:39,978 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:39,980 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,980 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:39,980 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:39,980 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:39,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:39,982 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:39,982 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:39,982 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:39,982 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,982 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:39,984 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,984 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,985 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:39,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:39,985 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,986 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:39,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:39,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:39,988 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:39,988 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:39,988 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:39,988 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:39,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,989 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:39,989 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:39,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:39,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:39,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:55:39,989 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:40,089 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:40,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:40,094 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:40,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:40,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,096 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:40,096 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:40,096 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:40,096 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:40,097 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,097 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,098 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:40,098 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:40,098 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,098 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:40,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,099 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:40,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:40,099 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:40,099 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:40,100 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:40,517 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101de79a736d8ab4726bfce655e67276731 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101de79a736d8ab4726bfce655e67276731 2023-03-30 16:55:40,524 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/454793113f0940f1b19634615659d2b5 2023-03-30 16:55:40,528 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/454793113f0940f1b19634615659d2b5 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/454793113f0940f1b19634615659d2b5 2023-03-30 16:55:40,531 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/454793113f0940f1b19634615659d2b5, entries=1, sequenceid=29, filesize=4.9 K 2023-03-30 16:55:40,532 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 432ms, sequenceid=29, compaction requested=true 2023-03-30 16:55:40,532 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:40,532 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:40,532 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:40,532 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:40,532 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,532 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:40,532 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:40,534 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@719c2b67[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:40,536 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:40,536 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,537 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,537 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:40,537 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:40,537 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,537 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:40,537 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:40,538 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:40,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:40,541 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:40,541 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:40,541 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:40,541 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,541 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:40,544 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,544 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:40,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,545 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:40,545 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,546 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,548 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:40,548 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:40,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:40,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:40,549 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:40,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:55:40,549 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:40,549 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:40,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:40,549 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:40,549 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:40,550 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,550 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,550 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,550 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,550 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,550 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,550 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,649 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:40,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:40,654 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:40,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:40,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,656 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:40,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:40,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:40,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:40,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,656 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,658 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:40,658 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:40,658 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,658 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:40,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,659 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:40,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:40,659 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:40,659 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:40,659 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:40,659 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:40,659 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:40,659 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:40,659 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:40,660 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:41,080 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a35369e348ec4f989c5b86e9301fe948 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103a35369e348ec4f989c5b86e9301fe948 2023-03-30 16:55:41,490 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/1e141c19010c414a879c0369039bfe76 2023-03-30 16:55:41,494 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/1e141c19010c414a879c0369039bfe76 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/1e141c19010c414a879c0369039bfe76 2023-03-30 16:55:41,499 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/1e141c19010c414a879c0369039bfe76, entries=1, sequenceid=33, filesize=4.9 K 2023-03-30 16:55:41,500 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 840ms, sequenceid=33, compaction requested=true 2023-03-30 16:55:41,500 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:41,500 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:41,502 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:41,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:41,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:41,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:41,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:41,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4386a782[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:41,505 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:41,505 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,508 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,508 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:41,508 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:41,508 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,508 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:41,508 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:41,510 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:41,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:41,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:41,512 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:41,513 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:41,513 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:41,513 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,513 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:41,517 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,517 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:41,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,517 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,518 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,519 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:41,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:41,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:41,523 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:41,523 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:41,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:55:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,524 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,524 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,523 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:41,523 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:41,524 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:41,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:41,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:41,624 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:41,629 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:41,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:41,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,630 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:41,630 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:41,630 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:41,630 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:41,631 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,631 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,632 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,632 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:41,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:41,632 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:41,632 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,633 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,633 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:41,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:41,633 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:41,633 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:41,634 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:41,634 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:41,634 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:41,644 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c9f56be166e6469d8d8611fa92bd0840 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907c9f56be166e6469d8d8611fa92bd0840 2023-03-30 16:55:42,049 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/6e87ba5552b544228bd1e78eb7b125ad 2023-03-30 16:55:42,054 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/6e87ba5552b544228bd1e78eb7b125ad as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/6e87ba5552b544228bd1e78eb7b125ad 2023-03-30 16:55:42,059 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/6e87ba5552b544228bd1e78eb7b125ad, entries=1, sequenceid=37, filesize=4.9 K 2023-03-30 16:55:42,060 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 426ms, sequenceid=37, compaction requested=true 2023-03-30 16:55:42,060 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:42,060 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:42,060 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:42,060 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:42,061 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,061 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:42,061 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:42,062 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,062 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:42,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,063 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:42,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:42,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b29d8fa[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:42,064 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:42,064 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,066 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,066 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:42,066 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,066 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:42,066 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:42,066 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:42,069 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,069 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:42,069 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:42,069 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:42,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:42,072 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:42,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:42,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:42,072 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,072 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:42,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,074 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:42,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:42,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:42,076 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:42,077 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,080 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:42,080 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:42,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:42,081 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:42,081 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:42,081 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,081 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:42,081 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:42,081 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,081 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:42,081 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,082 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:42,082 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,082 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,082 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,182 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:42,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:42,187 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:42,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:42,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,189 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:42,189 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:42,189 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-30 16:55:42,189 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-30 16:55:42,189 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,189 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,191 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,191 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:42,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:42,191 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:42,191 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,192 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,192 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-30 16:55:42,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-30 16:55:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-30 16:55:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-30 16:55:42,193 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:42,193 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:42,193 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. started... 2023-03-30 16:55:42,193 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f23fa6fb2a6b590b388346ecbb7010d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-30 16:55:42,605 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202a3f858b73bd464095d165a885c0509f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511202a3f858b73bd464095d165a885c0509f 2023-03-30 16:55:43,015 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/97bc41797c2846d28df842df8ee1dd55 2023-03-30 16:55:43,019 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/97bc41797c2846d28df842df8ee1dd55 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/97bc41797c2846d28df842df8ee1dd55 2023-03-30 16:55:43,025 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/97bc41797c2846d28df842df8ee1dd55, entries=1, sequenceid=41, filesize=4.9 K 2023-03-30 16:55:43,026 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f23fa6fb2a6b590b388346ecbb7010d3 in 833ms, sequenceid=41, compaction requested=true 2023-03-30 16:55:43,026 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:43,026 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:43,026 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-30 16:55:43,026 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-30 16:55:43,027 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,027 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-30 16:55:43,027 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-30 16:55:43,029 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,030 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,030 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:43,030 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:43,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-30 16:55:43,033 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-30 16:55:43,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@435ee7c7[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:43,033 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,034 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,034 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-30 16:55:43,034 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-30 16:55:43,034 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:43,034 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,035 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-30 16:55:43,036 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-30 16:55:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:43,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-30 16:55:43,039 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-30 16:55:43,039 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:43,039 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:43,039 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,039 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:43,040 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:43,041 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:43,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,041 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,042 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,045 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:43,045 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:43,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:43,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:43,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,046 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:43,046 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-30 16:55:43,046 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:43,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-30 16:55:43,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:43,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,046 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,047 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,047 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:43,047 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:43,147 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:43,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:43,149 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-30 16:55:43,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:55:43,151 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:55:43,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:55:43,152 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195943152 2023-03-30 16:55:43,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-30 16:55:43,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-30 16:55:43,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:43,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x2c20834d to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:55:43,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71038aba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:55:43,163 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:43,596 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010388fad5ec0846457a804d871795b1c339 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010388fad5ec0846457a804d871795b1c339 2023-03-30 16:55:43,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:43,611 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:55:43,613 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:55:43,622 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:55:43,623 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45730, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:55:43,633 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de2163f52cf04b68bdccbb8603bcbfe4 first=Optional[r5] last=Optional[r6] 2023-03-30 16:55:43,634 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de2163f52cf04b68bdccbb8603bcbfe4}] 2023-03-30 16:55:43,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de2163f52cf04b68bdccbb8603bcbfe4 for inclusion in f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:43,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-30 16:55:43,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:55:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de2163f52cf04b68bdccbb8603bcbfe4 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdt35v22o7ehidicc8gmc7phigonkidulfcddmc1j5iv2qf0va3g1a16gc6cgv68/family1/de2163f52cf04b68bdccbb8603bcbfe4 2023-03-30 16:55:43,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdt35v22o7ehidicc8gmc7phigonkidulfcddmc1j5iv2qf0va3g1a16gc6cgv68/family1/de2163f52cf04b68bdccbb8603bcbfe4 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_ 2023-03-30 16:55:43,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdt35v22o7ehidicc8gmc7phigonkidulfcddmc1j5iv2qf0va3g1a16gc6cgv68/family1/de2163f52cf04b68bdccbb8603bcbfe4 into f23fa6fb2a6b590b388346ecbb7010d3/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_ - updating store file list. 2023-03-30 16:55:43,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_ into f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:43,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdt35v22o7ehidicc8gmc7phigonkidulfcddmc1j5iv2qf0va3g1a16gc6cgv68/family1/de2163f52cf04b68bdccbb8603bcbfe4 into f23fa6fb2a6b590b388346ecbb7010d3/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_) 2023-03-30 16:55:43,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdt35v22o7ehidicc8gmc7phigonkidulfcddmc1j5iv2qf0va3g1a16gc6cgv68/family1/de2163f52cf04b68bdccbb8603bcbfe4 2023-03-30 16:55:43,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-30 16:55:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-30 16:55:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(1912): f23fa6fb2a6b590b388346ecbb7010d3/family1 is initiating minor compaction 2023-03-30 16:55:43,655 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f23fa6fb2a6b590b388346ecbb7010d3/family1 in testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:43,655 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/2bfc95a73cb64a9881809c927a447555, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a6896c0a0b6f46ac9620b54b884abf69, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/e3c70290a5424cfa8fc7f2c5ca4ca039, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/ab48661dde5b46bcae714894ceab46d0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a7a4b3d7870049139a0871a9cfc73397, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/454793113f0940f1b19634615659d2b5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/1e141c19010c414a879c0369039bfe76, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/6e87ba5552b544228bd1e78eb7b125ad, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/97bc41797c2846d28df842df8ee1dd55, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp, totalSize=49.7 K 2023-03-30 16:55:43,655 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting 2bfc95a73cb64a9881809c927a447555, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting a6896c0a0b6f46ac9620b54b884abf69, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting e3c70290a5424cfa8fc7f2c5ca4ca039, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting ab48661dde5b46bcae714894ceab46d0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting a7a4b3d7870049139a0871a9cfc73397, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting 454793113f0940f1b19634615659d2b5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-30 16:55:43,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@29807b16; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting 1e141c19010c414a879c0369039bfe76, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting 6e87ba5552b544228bd1e78eb7b125ad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting 97bc41797c2846d28df842df8ee1dd55, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-30 16:55:43,656 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] compactions.Compactor(207): Compacting 7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-30 16:55:43,668 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:43,669 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:43,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101de79a736d8ab4726bfce655e67276731 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101de79a736d8ab4726bfce655e67276731 2023-03-30 16:55:43,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103a35369e348ec4f989c5b86e9301fe948 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103a35369e348ec4f989c5b86e9301fe948 2023-03-30 16:55:43,673 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-30 16:55:43,673 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-30 16:55:43,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:43,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:43,756 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] throttle.PressureAwareThroughputController(145): f23fa6fb2a6b590b388346ecbb7010d3#family1#compaction#166 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:43,766 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c7ad7399ac5a4a11962419050e1fd4f7 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c7ad7399ac5a4a11962419050e1fd4f7 2023-03-30 16:55:43,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:43,824 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e6ee7ad7f9d44ad8ac837d57c548597b first=Optional[r1] last=Optional[r4] 2023-03-30 16:55:43,825 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e6ee7ad7f9d44ad8ac837d57c548597b}] 2023-03-30 16:55:43,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e6ee7ad7f9d44ad8ac837d57c548597b for inclusion in f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:43,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-30 16:55:43,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:55:43,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:43,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e6ee7ad7f9d44ad8ac837d57c548597b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dsttul80c40b974du4qe0p9pvgkt84427256quoaldmub26d2ucnog67jnb60r0a/family1/e6ee7ad7f9d44ad8ac837d57c548597b 2023-03-30 16:55:43,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dsttul80c40b974du4qe0p9pvgkt84427256quoaldmub26d2ucnog67jnb60r0a/family1/e6ee7ad7f9d44ad8ac837d57c548597b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/20b66ce5a1684faeabb064dd0ce87d32_SeqId_46_ 2023-03-30 16:55:43,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dsttul80c40b974du4qe0p9pvgkt84427256quoaldmub26d2ucnog67jnb60r0a/family1/e6ee7ad7f9d44ad8ac837d57c548597b into f23fa6fb2a6b590b388346ecbb7010d3/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/20b66ce5a1684faeabb064dd0ce87d32_SeqId_46_ - updating store file list. 2023-03-30 16:55:43,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/20b66ce5a1684faeabb064dd0ce87d32_SeqId_46_ into f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:43,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dsttul80c40b974du4qe0p9pvgkt84427256quoaldmub26d2ucnog67jnb60r0a/family1/e6ee7ad7f9d44ad8ac837d57c548597b into f23fa6fb2a6b590b388346ecbb7010d3/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/20b66ce5a1684faeabb064dd0ce87d32_SeqId_46_) 2023-03-30 16:55:43,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dsttul80c40b974du4qe0p9pvgkt84427256quoaldmub26d2ucnog67jnb60r0a/family1/e6ee7ad7f9d44ad8ac837d57c548597b 2023-03-30 16:55:43,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:43,840 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:43,842 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012f3bd1507d104a1f9bf1878d256fdcbe to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012f3bd1507d104a1f9bf1878d256fdcbe 2023-03-30 16:55:43,843 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205023a6b41cdd2452293e967a7a40200da to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205023a6b41cdd2452293e967a7a40200da 2023-03-30 16:55:43,844 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284afa2c7a0eba41f48fecd3ddeb815cb2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284afa2c7a0eba41f48fecd3ddeb815cb2 2023-03-30 16:55:43,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa7816836ea7447cb31d9b43ea140a47 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa7816836ea7447cb31d9b43ea140a47 2023-03-30 16:55:43,846 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-30 16:55:43,846 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-30 16:55:43,846 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:43,846 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:44,290 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a9e7c2e5644947d099fe49b65cac3267 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a9e7c2e5644947d099fe49b65cac3267 2023-03-30 16:55:44,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:44,359 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5def5696a9a54b18ac180fe6671438d1 first=Optional[r00] last=Optional[r8] 2023-03-30 16:55:44,360 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5def5696a9a54b18ac180fe6671438d1}] 2023-03-30 16:55:44,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5def5696a9a54b18ac180fe6671438d1 for inclusion in f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-30 16:55:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last= 2023-03-30 16:55:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:44,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5def5696a9a54b18ac180fe6671438d1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8fqg14on7sv5qtm9qrq6q295f0m3b0jqpg2ki46jvsd00pon624cohj18v9ai451/family1/5def5696a9a54b18ac180fe6671438d1 2023-03-30 16:55:44,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8fqg14on7sv5qtm9qrq6q295f0m3b0jqpg2ki46jvsd00pon624cohj18v9ai451/family1/5def5696a9a54b18ac180fe6671438d1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/4facacb60fa74e358694fcd58bf38be8_SeqId_48_ 2023-03-30 16:55:44,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8fqg14on7sv5qtm9qrq6q295f0m3b0jqpg2ki46jvsd00pon624cohj18v9ai451/family1/5def5696a9a54b18ac180fe6671438d1 into f23fa6fb2a6b590b388346ecbb7010d3/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/4facacb60fa74e358694fcd58bf38be8_SeqId_48_ - updating store file list. 2023-03-30 16:55:44,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/4facacb60fa74e358694fcd58bf38be8_SeqId_48_ into f23fa6fb2a6b590b388346ecbb7010d3/family1 2023-03-30 16:55:44,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8fqg14on7sv5qtm9qrq6q295f0m3b0jqpg2ki46jvsd00pon624cohj18v9ai451/family1/5def5696a9a54b18ac180fe6671438d1 into f23fa6fb2a6b590b388346ecbb7010d3/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/4facacb60fa74e358694fcd58bf38be8_SeqId_48_) 2023-03-30 16:55:44,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8fqg14on7sv5qtm9qrq6q295f0m3b0jqpg2ki46jvsd00pon624cohj18v9ai451/family1/5def5696a9a54b18ac180fe6671438d1 2023-03-30 16:55:44,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(75): Selecting compaction from 13 store files, 10 compacting, 2 eligible, 16 blocking 2023-03-30 16:55:44,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-30 16:55:44,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-30 16:55:44,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.CompactSplit(415): Not compacting testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. because compaction request was cancelled 2023-03-30 16:55:44,375 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:44,376 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:44,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511202a3f858b73bd464095d165a885c0509f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511202a3f858b73bd464095d165a885c0509f 2023-03-30 16:55:44,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281f57b00d08a549689d0b5d40f42d625f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281f57b00d08a549689d0b5d40f42d625f 2023-03-30 16:55:44,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511303aa4869203a24f179634883706d8734e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511303aa4869203a24f179634883706d8734e 2023-03-30 16:55:44,380 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-30 16:55:44,380 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-30 16:55:44,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:44,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:44,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-30 16:55:44,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-30 16:55:44,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:55:44,383 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-30 16:55:44,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.2330 sec 2023-03-30 16:55:44,583 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/.tmp/family1/d4cb380cc2814b2ca748d61edcdef4c2 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/d4cb380cc2814b2ca748d61edcdef4c2 2023-03-30 16:55:44,588 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f23fa6fb2a6b590b388346ecbb7010d3/family1 of f23fa6fb2a6b590b388346ecbb7010d3 into d4cb380cc2814b2ca748d61edcdef4c2(size=6.6 K), total size for store is 344.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:44,589 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:44,589 INFO [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1680195343655; duration=0sec 2023-03-30 16:55:44,589 DEBUG [RS:0;jenkins-hbase4:39029-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-30 16:55:44,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/2bfc95a73cb64a9881809c927a447555, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a6896c0a0b6f46ac9620b54b884abf69, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/e3c70290a5424cfa8fc7f2c5ca4ca039, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/ab48661dde5b46bcae714894ceab46d0, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a7a4b3d7870049139a0871a9cfc73397, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/454793113f0940f1b19634615659d2b5, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/1e141c19010c414a879c0369039bfe76, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/6e87ba5552b544228bd1e78eb7b125ad, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/97bc41797c2846d28df842df8ee1dd55, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_] to archive 2023-03-30 16:55:44,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:44,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/2bfc95a73cb64a9881809c927a447555 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/2bfc95a73cb64a9881809c927a447555 2023-03-30 16:55:44,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a6896c0a0b6f46ac9620b54b884abf69 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a6896c0a0b6f46ac9620b54b884abf69 2023-03-30 16:55:44,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/e3c70290a5424cfa8fc7f2c5ca4ca039 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/e3c70290a5424cfa8fc7f2c5ca4ca039 2023-03-30 16:55:44,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/ab48661dde5b46bcae714894ceab46d0 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/ab48661dde5b46bcae714894ceab46d0 2023-03-30 16:55:44,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a7a4b3d7870049139a0871a9cfc73397 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/a7a4b3d7870049139a0871a9cfc73397 2023-03-30 16:55:44,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/454793113f0940f1b19634615659d2b5 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/454793113f0940f1b19634615659d2b5 2023-03-30 16:55:44,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/1e141c19010c414a879c0369039bfe76 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/1e141c19010c414a879c0369039bfe76 2023-03-30 16:55:44,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/6e87ba5552b544228bd1e78eb7b125ad to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/6e87ba5552b544228bd1e78eb7b125ad 2023-03-30 16:55:44,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/97bc41797c2846d28df842df8ee1dd55 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/97bc41797c2846d28df842df8ee1dd55 2023-03-30 16:55:44,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_ to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/family1/7b3741ccd32646a2b04a3b0cb05e1189_SeqId_44_ 2023-03-30 16:55:44,690 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250 (was 251), OpenFileDescriptor=639 (was 632) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 397), ProcessCount=169 (was 169), AvailableMemoryMB=4336 (was 4354) 2023-03-30 16:55:44,705 INFO [Listener at localhost/41799] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250, OpenFileDescriptor=639, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=169, AvailableMemoryMB=4335 2023-03-30 16:55:44,731 DEBUG [Listener at localhost/41799] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-30 16:55:44,795 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6l\xEF\xA6d\xEB\xAF\xB5_\xA4\xDB\xC0S\x0C\x02n"\x10-\xEDi\x8FY\xF9\x12D \x0En'\x06UMF*\x10\xD03B\x8B/\xE5\x12P[\xF3\xB6\x1D\xE6\xEE\x0Fm2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-30 16:55:44,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-30 16:55:44,797 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-30 16:55:44,798 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-30 16:55:44,798 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-30 16:55:44,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-30 16:55:44,801 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:44,801 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc 2023-03-30 16:55:44,802 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834 empty. 2023-03-30 16:55:44,802 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:44,802 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc empty. 2023-03-30 16:55:44,802 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:44,802 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c empty. 2023-03-30 16:55:44,803 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc 2023-03-30 16:55:44,803 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:44,803 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-30 16:55:44,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-30 16:55:45,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-30 16:55:45,220 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-30 16:55:45,222 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f1908d0b8069b3bb15eeb0c2b924834, NAME => 'testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6l\xEF\xA6d\xEB\xAF\xB5_\xA4\xDB\xC0S\x0C\x02n"\x10-\xEDi\x8FY\xF9\x12D \x0En'\x06UMF*\x10\xD03B\x8B/\xE5\x12P[\xF3\xB6\x1D\xE6\xEE\x0Fm2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:55:45,229 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0380f23217501ebeee416907da941edc, NAME => 'testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6l\xEF\xA6d\xEB\xAF\xB5_\xA4\xDB\xC0S\x0C\x02n"\x10-\xEDi\x8FY\xF9\x12D \x0En'\x06UMF*\x10\xD03B\x8B/\xE5\x12P[\xF3\xB6\x1D\xE6\xEE\x0Fm2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:55:45,229 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => c7695a45c92e578f7e75f346d842c67c, NAME => 'testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6l\xEF\xA6d\xEB\xAF\xB5_\xA4\xDB\xC0S\x0C\x02n"\x10-\xEDi\x8FY\xF9\x12D \x0En'\x06UMF*\x10\xD03B\x8B/\xE5\x12P[\xF3\xB6\x1D\xE6\xEE\x0Fm2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/.tmp 2023-03-30 16:55:45,242 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:45,242 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 0380f23217501ebeee416907da941edc, disabling compactions & flushes 2023-03-30 16:55:45,242 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:45,242 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:45,242 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. after waiting 0 ms 2023-03-30 16:55:45,242 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:45,242 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:45,242 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:45,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 0f1908d0b8069b3bb15eeb0c2b924834, disabling compactions & flushes 2023-03-30 16:55:45,646 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. after waiting 0 ms 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:45,646 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing c7695a45c92e578f7e75f346d842c67c, disabling compactions & flushes 2023-03-30 16:55:45,646 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. after waiting 0 ms 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:45,646 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:45,646 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:45,649 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-30 16:55:45,649 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680195345649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195345649"}]},"ts":"1680195345649"} 2023-03-30 16:55:45,650 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195345649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195345649"}]},"ts":"1680195345649"} 2023-03-30 16:55:45,650 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195345649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680195345649"}]},"ts":"1680195345649"} 2023-03-30 16:55:45,652 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-30 16:55:45,652 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-30 16:55:45,652 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195345652"}]},"ts":"1680195345652"} 2023-03-30 16:55:45,655 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-30 16:55:45,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f1908d0b8069b3bb15eeb0c2b924834, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0380f23217501ebeee416907da941edc, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c7695a45c92e578f7e75f346d842c67c, ASSIGN}] 2023-03-30 16:55:45,661 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c7695a45c92e578f7e75f346d842c67c, ASSIGN 2023-03-30 16:55:45,661 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f1908d0b8069b3bb15eeb0c2b924834, ASSIGN 2023-03-30 16:55:45,661 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0380f23217501ebeee416907da941edc, ASSIGN 2023-03-30 16:55:45,662 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c7695a45c92e578f7e75f346d842c67c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:55:45,662 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f1908d0b8069b3bb15eeb0c2b924834, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:55:45,662 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0380f23217501ebeee416907da941edc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39029,1680195214375; forceNewPlan=false, retain=false 2023-03-30 16:55:45,814 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0380f23217501ebeee416907da941edc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:45,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=0f1908d0b8069b3bb15eeb0c2b924834, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:45,814 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c7695a45c92e578f7e75f346d842c67c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:45,814 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680195345814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195345814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195345814"}]},"ts":"1680195345814"} 2023-03-30 16:55:45,814 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195345814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195345814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195345814"}]},"ts":"1680195345814"} 2023-03-30 16:55:45,814 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195345814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680195345814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680195345814"}]},"ts":"1680195345814"} 2023-03-30 16:55:45,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 0380f23217501ebeee416907da941edc, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:45,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure c7695a45c92e578f7e75f346d842c67c, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:45,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 0f1908d0b8069b3bb15eeb0c2b924834, server=jenkins-hbase4.apache.org,39029,1680195214375}] 2023-03-30 16:55:45,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-30 16:55:45,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7695a45c92e578f7e75f346d842c67c, NAME => 'testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c.', STARTKEY => '2', ENDKEY => ''} 2023-03-30 16:55:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:45,995 INFO [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:45,997 DEBUG [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1 2023-03-30 16:55:45,997 DEBUG [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1 2023-03-30 16:55:45,997 INFO [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7695a45c92e578f7e75f346d842c67c columnFamilyName family1 2023-03-30 16:55:45,999 INFO [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] regionserver.HStore(310): Store=c7695a45c92e578f7e75f346d842c67c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:45,999 INFO [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:46,000 DEBUG [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2 2023-03-30 16:55:46,000 DEBUG [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2 2023-03-30 16:55:46,001 INFO [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7695a45c92e578f7e75f346d842c67c columnFamilyName family2 2023-03-30 16:55:46,002 INFO [StoreOpener-c7695a45c92e578f7e75f346d842c67c-1] regionserver.HStore(310): Store=c7695a45c92e578f7e75f346d842c67c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:46,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:46,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:46,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:46,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:46,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:55:46,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7695a45c92e578f7e75f346d842c67c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61665942, jitterRate=-0.08110585808753967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:46,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:46,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c., pid=121, masterSystemTime=1680195345967 2023-03-30 16:55:46,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:46,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:46,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:46,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0380f23217501ebeee416907da941edc, NAME => 'testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc.', STARTKEY => '1', ENDKEY => '2'} 2023-03-30 16:55:46,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:46,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,012 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c7695a45c92e578f7e75f346d842c67c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:46,013 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195346012"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195346012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195346012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195346012"}]},"ts":"1680195346012"} 2023-03-30 16:55:46,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-03-30 16:55:46,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure c7695a45c92e578f7e75f346d842c67c, server=jenkins-hbase4.apache.org,39029,1680195214375 in 198 msec 2023-03-30 16:55:46,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c7695a45c92e578f7e75f346d842c67c, ASSIGN in 357 msec 2023-03-30 16:55:46,037 INFO [StoreOpener-0380f23217501ebeee416907da941edc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,038 DEBUG [StoreOpener-0380f23217501ebeee416907da941edc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1 2023-03-30 16:55:46,038 DEBUG [StoreOpener-0380f23217501ebeee416907da941edc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1 2023-03-30 16:55:46,039 INFO [StoreOpener-0380f23217501ebeee416907da941edc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0380f23217501ebeee416907da941edc columnFamilyName family1 2023-03-30 16:55:46,040 INFO [StoreOpener-0380f23217501ebeee416907da941edc-1] regionserver.HStore(310): Store=0380f23217501ebeee416907da941edc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:46,040 INFO [StoreOpener-0380f23217501ebeee416907da941edc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,041 DEBUG [StoreOpener-0380f23217501ebeee416907da941edc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2 2023-03-30 16:55:46,041 DEBUG [StoreOpener-0380f23217501ebeee416907da941edc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2 2023-03-30 16:55:46,042 INFO [StoreOpener-0380f23217501ebeee416907da941edc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0380f23217501ebeee416907da941edc columnFamilyName family2 2023-03-30 16:55:46,042 INFO [StoreOpener-0380f23217501ebeee416907da941edc-1] regionserver.HStore(310): Store=0380f23217501ebeee416907da941edc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:46,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:46,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0380f23217501ebeee416907da941edc 2023-03-30 16:55:46,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:55:46,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0380f23217501ebeee416907da941edc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69205926, jitterRate=0.031248658895492554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:46,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:46,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc., pid=120, masterSystemTime=1680195345967 2023-03-30 16:55:46,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:46,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:46,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:46,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f1908d0b8069b3bb15eeb0c2b924834, NAME => 'testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834.', STARTKEY => '', ENDKEY => '1'} 2023-03-30 16:55:46,049 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0380f23217501ebeee416907da941edc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:46,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-30 16:55:46,050 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680195346049"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195346049"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195346049"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195346049"}]},"ts":"1680195346049"} 2023-03-30 16:55:46,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-03-30 16:55:46,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 0380f23217501ebeee416907da941edc, server=jenkins-hbase4.apache.org,39029,1680195214375 in 236 msec 2023-03-30 16:55:46,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0380f23217501ebeee416907da941edc, ASSIGN in 393 msec 2023-03-30 16:55:46,073 INFO [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,074 DEBUG [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1 2023-03-30 16:55:46,074 DEBUG [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1 2023-03-30 16:55:46,074 INFO [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f1908d0b8069b3bb15eeb0c2b924834 columnFamilyName family1 2023-03-30 16:55:46,075 INFO [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] regionserver.HStore(310): Store=0f1908d0b8069b3bb15eeb0c2b924834/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:46,075 INFO [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,076 DEBUG [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2 2023-03-30 16:55:46,076 DEBUG [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2 2023-03-30 16:55:46,077 INFO [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f1908d0b8069b3bb15eeb0c2b924834 columnFamilyName family2 2023-03-30 16:55:46,077 INFO [StoreOpener-0f1908d0b8069b3bb15eeb0c2b924834-1] regionserver.HStore(310): Store=0f1908d0b8069b3bb15eeb0c2b924834/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-30 16:55:46,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-30 16:55:46,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:46,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-30 16:55:46,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f1908d0b8069b3bb15eeb0c2b924834; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65018438, jitterRate=-0.03114977478981018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-30 16:55:46,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:46,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834., pid=122, masterSystemTime=1680195345967 2023-03-30 16:55:46,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:46,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:46,085 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=0f1908d0b8069b3bb15eeb0c2b924834, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:46,085 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680195346085"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680195346085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680195346085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680195346085"}]},"ts":"1680195346085"} 2023-03-30 16:55:46,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-03-30 16:55:46,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 0f1908d0b8069b3bb15eeb0c2b924834, server=jenkins-hbase4.apache.org,39029,1680195214375 in 264 msec 2023-03-30 16:55:46,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-03-30 16:55:46,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f1908d0b8069b3bb15eeb0c2b924834, ASSIGN in 428 msec 2023-03-30 16:55:46,089 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-30 16:55:46,089 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680195346089"}]},"ts":"1680195346089"} 2023-03-30 16:55:46,090 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-30 16:55:46,092 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-30 16:55:46,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2970 sec 2023-03-30 16:55:46,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-30 16:55:46,907 INFO [Listener at localhost/41799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-30 16:55:46,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:46,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:46,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:46,917 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:46,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-30 16:55:46,918 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-30 16:55:46,918 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:46,918 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-30 16:55:46,918 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-30 16:55:46,919 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:46,919 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:46,922 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:46,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:46,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:46,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:46,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:46,923 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:46,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:46,924 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:46,924 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:46,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:46,924 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-30 16:55:46,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-30 16:55:46,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-30 16:55:46,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:46,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-30 16:55:46,924 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:46,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:46,924 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:46,924 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:46,924 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. started... 2023-03-30 16:55:46,924 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:46,925 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. started... 2023-03-30 16:55:46,925 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. started... 2023-03-30 16:55:46,926 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0f1908d0b8069b3bb15eeb0c2b924834 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:55:46,927 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0380f23217501ebeee416907da941edc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:55:46,927 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c7695a45c92e578f7e75f346d842c67c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-30 16:55:47,003 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330530abe1572154996becd4dde6527514e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330530abe1572154996becd4dde6527514e 2023-03-30 16:55:47,024 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/02c95dd495814f81a6e6966fcec1276c 2023-03-30 16:55:47,066 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330b8870836f89f4962831a4d109817b036 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230330b8870836f89f4962831a4d109817b036 2023-03-30 16:55:47,072 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/92ddae4c0aa14e109eff7b5e8a60e5ce 2023-03-30 16:55:47,077 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/02c95dd495814f81a6e6966fcec1276c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/02c95dd495814f81a6e6966fcec1276c 2023-03-30 16:55:47,112 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/02c95dd495814f81a6e6966fcec1276c, entries=4, sequenceid=5, filesize=5.5 K 2023-03-30 16:55:47,112 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/92ddae4c0aa14e109eff7b5e8a60e5ce as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/92ddae4c0aa14e109eff7b5e8a60e5ce 2023-03-30 16:55:47,116 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/92ddae4c0aa14e109eff7b5e8a60e5ce, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:55:47,118 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c7695a45c92e578f7e75f346d842c67c in 191ms, sequenceid=5, compaction requested=false 2023-03-30 16:55:47,118 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-30 16:55:47,119 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:47,119 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:47,119 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:47,394 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330e685c290e61641f19c3e39b43cd7b115 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330e685c290e61641f19c3e39b43cd7b115 2023-03-30 16:55:47,405 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303307ff33b8416f7493db6fb80813e2e5f49 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303307ff33b8416f7493db6fb80813e2e5f49 2023-03-30 16:55:47,416 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/b5bf299a72224b0da06250c5e39ea080 2023-03-30 16:55:47,428 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/f169055c657c4a5b89f5368c970f226c 2023-03-30 16:55:47,864 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330cf960e49b98145c291002443b824dfa5 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230330cf960e49b98145c291002443b824dfa5 2023-03-30 16:55:47,874 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303307144b00ef8cb4462848d78b8e671f30a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303307144b00ef8cb4462848d78b8e671f30a 2023-03-30 16:55:47,879 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/d12cfb28522e49789e6a0da916ab2487 2023-03-30 16:55:47,883 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/f169055c657c4a5b89f5368c970f226c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f169055c657c4a5b89f5368c970f226c 2023-03-30 16:55:47,909 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f169055c657c4a5b89f5368c970f226c, entries=4, sequenceid=5, filesize=5.5 K 2023-03-30 16:55:47,910 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/d12cfb28522e49789e6a0da916ab2487 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/d12cfb28522e49789e6a0da916ab2487 2023-03-30 16:55:47,913 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/d12cfb28522e49789e6a0da916ab2487, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:55:47,914 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0f1908d0b8069b3bb15eeb0c2b924834 in 989ms, sequenceid=5, compaction requested=false 2023-03-30 16:55:47,914 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:47,915 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:47,915 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:48,270 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/f1241ec499a445e2a95a55ded286d6c2 2023-03-30 16:55:48,274 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/b5bf299a72224b0da06250c5e39ea080 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/b5bf299a72224b0da06250c5e39ea080 2023-03-30 16:55:48,308 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/b5bf299a72224b0da06250c5e39ea080, entries=4, sequenceid=5, filesize=5.5 K 2023-03-30 16:55:48,309 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/f1241ec499a445e2a95a55ded286d6c2 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/f1241ec499a445e2a95a55ded286d6c2 2023-03-30 16:55:48,313 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/f1241ec499a445e2a95a55ded286d6c2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-30 16:55:48,313 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0380f23217501ebeee416907da941edc in 1386ms, sequenceid=5, compaction requested=false 2023-03-30 16:55:48,313 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:48,314 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:48,314 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:48,314 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:48,314 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,314 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-30 16:55:48,314 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-30 16:55:48,315 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:48,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-30 16:55:48,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53093bd8[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:48,317 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-30 16:55:48,317 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,318 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-30 16:55:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-30 16:55:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:48,318 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,318 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:48,320 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:48,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:48,320 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-30 16:55:48,320 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:48,320 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-30 16:55:48,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:48,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:48,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:48,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:48,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:48,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:48,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-30 16:55:48,323 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-30 16:55:48,323 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:48,323 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:48,323 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-30 16:55:48,323 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:48,324 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,324 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,324 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:48,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:48,325 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:48,326 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:48,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,328 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:48,328 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:48,328 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:48,328 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:48,328 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-30 16:55:48,328 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:48,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-30 16:55:48,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:48,328 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:48,328 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:48,328 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,329 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,329 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:48,329 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:48,329 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:48,329 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,429 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:48,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:48,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:48,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:48,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:48,434 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:48,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:48,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-30 16:55:48,440 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-30 16:55:48,440 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:48,440 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-30 16:55:48,440 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-30 16:55:48,440 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,440 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:48,442 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,442 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:48,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:48,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:48,442 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:48,442 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:48,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:48,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:48,443 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-30 16:55:48,443 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-30 16:55:48,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-30 16:55:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-30 16:55:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-30 16:55:48,444 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:48,444 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. started... 2023-03-30 16:55:48,444 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:48,444 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:48,444 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:48,444 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0f1908d0b8069b3bb15eeb0c2b924834 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:55:48,444 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:48,444 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. started... 2023-03-30 16:55:48,444 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. started... 2023-03-30 16:55:48,444 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c7695a45c92e578f7e75f346d842c67c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:55:48,444 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0380f23217501ebeee416907da941edc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-30 16:55:48,541 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303305c0b8bfc523d41808df00948bbad9033 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303305c0b8bfc523d41808df00948bbad9033 2023-03-30 16:55:48,545 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303307e68a36968014093a3958a81107afe5f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303307e68a36968014093a3958a81107afe5f 2023-03-30 16:55:48,549 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330d6aea8941c1d4bc58fa8d6d1400d798e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330d6aea8941c1d4bc58fa8d6d1400d798e 2023-03-30 16:55:48,580 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/f4ebd68c6e8b4410b1fcde3721df8597 2023-03-30 16:55:48,580 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/ad82192504334a34b77e0a708ed2bbbb 2023-03-30 16:55:48,583 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/e8bc32fe3dc847afa39a8e73c969df51 2023-03-30 16:55:48,647 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033045cff53dfd43427fbe96a485d1b27878 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023033045cff53dfd43427fbe96a485d1b27878 2023-03-30 16:55:48,662 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/a60c334d9d61492a8c9130fe4aee5cd9 2023-03-30 16:55:48,665 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033062db581352894553b798480c66426e41 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023033062db581352894553b798480c66426e41 2023-03-30 16:55:48,666 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/ad82192504334a34b77e0a708ed2bbbb as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/ad82192504334a34b77e0a708ed2bbbb 2023-03-30 16:55:48,669 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/271405bfac4e4c9ab54a8602f9440320 2023-03-30 16:55:48,681 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/e8bc32fe3dc847afa39a8e73c969df51 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/e8bc32fe3dc847afa39a8e73c969df51 2023-03-30 16:55:48,692 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/ad82192504334a34b77e0a708ed2bbbb, entries=4, sequenceid=9, filesize=5.5 K 2023-03-30 16:55:48,693 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/a60c334d9d61492a8c9130fe4aee5cd9 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/a60c334d9d61492a8c9130fe4aee5cd9 2023-03-30 16:55:48,696 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/a60c334d9d61492a8c9130fe4aee5cd9, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:55:48,697 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0380f23217501ebeee416907da941edc in 253ms, sequenceid=9, compaction requested=false 2023-03-30 16:55:48,697 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:48,697 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:48,697 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:48,717 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/e8bc32fe3dc847afa39a8e73c969df51, entries=4, sequenceid=9, filesize=5.5 K 2023-03-30 16:55:48,720 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/271405bfac4e4c9ab54a8602f9440320 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/271405bfac4e4c9ab54a8602f9440320 2023-03-30 16:55:48,723 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/271405bfac4e4c9ab54a8602f9440320, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:55:48,724 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c7695a45c92e578f7e75f346d842c67c in 280ms, sequenceid=9, compaction requested=false 2023-03-30 16:55:48,724 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:48,724 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:48,724 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:49,034 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303300506fa56c3244bbb9452dd7bdf5308af to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303300506fa56c3244bbb9452dd7bdf5308af 2023-03-30 16:55:49,439 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/54f2340236394e809be1badb15d6646a 2023-03-30 16:55:49,443 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/f4ebd68c6e8b4410b1fcde3721df8597 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f4ebd68c6e8b4410b1fcde3721df8597 2023-03-30 16:55:49,470 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f4ebd68c6e8b4410b1fcde3721df8597, entries=4, sequenceid=9, filesize=5.5 K 2023-03-30 16:55:49,471 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/54f2340236394e809be1badb15d6646a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/54f2340236394e809be1badb15d6646a 2023-03-30 16:55:49,474 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/54f2340236394e809be1badb15d6646a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-30 16:55:49,475 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0f1908d0b8069b3bb15eeb0c2b924834 in 1031ms, sequenceid=9, compaction requested=false 2023-03-30 16:55:49,475 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:49,475 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-30 16:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-30 16:55:49,477 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,477 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:49,478 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,478 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:49,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:49,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:49,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:49,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:49,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-30 16:55:49,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c52c8c[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:49,479 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-30 16:55:49,479 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,480 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-30 16:55:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-30 16:55:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:49,480 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,480 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-30 16:55:49,483 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:49,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:49,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-30 16:55:49,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-30 16:55:49,485 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-30 16:55:49,485 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:49,485 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:49,485 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-30 16:55:49,485 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:49,487 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,487 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:49,487 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:49,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:49,487 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:49,489 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:49,491 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:49,491 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-30 16:55:49,491 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:49,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:49,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,491 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:49,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:49,591 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:49,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:49,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:49,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:49,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:49,597 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:49,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:49,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-30 16:55:49,599 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-30 16:55:49,599 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:49,599 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-30 16:55:49,599 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-30 16:55:49,599 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,599 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:49,600 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:49,600 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:49,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:49,601 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:49,601 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:49,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:49,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:49,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:49,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:49,602 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-30 16:55:49,602 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-30 16:55:49,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-30 16:55:49,602 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-30 16:55:49,602 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:49,602 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-30 16:55:49,604 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:49,604 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. started... 2023-03-30 16:55:49,604 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:49,604 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:49,604 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:49,604 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0f1908d0b8069b3bb15eeb0c2b924834 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:55:49,604 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:49,604 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. started... 2023-03-30 16:55:49,604 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. started... 2023-03-30 16:55:49,604 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c7695a45c92e578f7e75f346d842c67c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:55:49,604 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0380f23217501ebeee416907da941edc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-30 16:55:49,680 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330459bfce2a65e434797e2a38bcfbf04df to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230330459bfce2a65e434797e2a38bcfbf04df 2023-03-30 16:55:49,684 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330d9f79103d5dd40c8b0945074bf58d667 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330d9f79103d5dd40c8b0945074bf58d667 2023-03-30 16:55:49,718 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/9454838571b0489ea0a0c1e216cb45b8 2023-03-30 16:55:49,771 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303302f18433ba9e84bebbd7a011dad2f6d1f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303302f18433ba9e84bebbd7a011dad2f6d1f 2023-03-30 16:55:49,778 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/bed0a0be69dc49f7ab66c8ddbeea288a 2023-03-30 16:55:49,784 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/9454838571b0489ea0a0c1e216cb45b8 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/9454838571b0489ea0a0c1e216cb45b8 2023-03-30 16:55:49,818 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/9454838571b0489ea0a0c1e216cb45b8, entries=4, sequenceid=13, filesize=5.5 K 2023-03-30 16:55:49,819 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/bed0a0be69dc49f7ab66c8ddbeea288a as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/bed0a0be69dc49f7ab66c8ddbeea288a 2023-03-30 16:55:49,823 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/bed0a0be69dc49f7ab66c8ddbeea288a, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:55:49,824 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0380f23217501ebeee416907da941edc in 220ms, sequenceid=13, compaction requested=true 2023-03-30 16:55:49,825 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:49,825 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:49,825 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:50,067 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330825d07570e104a6cbc63925be3f884a3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330825d07570e104a6cbc63925be3f884a3 2023-03-30 16:55:50,088 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/d0746a2d6bbc457f81048213c505f2ed 2023-03-30 16:55:50,113 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/73ef6dc201cd4c3496f22dda813d5d99 2023-03-30 16:55:50,175 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303302dd0d74d51444b05a2bc9db7bc957ff8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303302dd0d74d51444b05a2bc9db7bc957ff8 2023-03-30 16:55:50,180 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/37b1f7283df742b6850ab4b86d4abbc6 2023-03-30 16:55:50,185 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/73ef6dc201cd4c3496f22dda813d5d99 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/73ef6dc201cd4c3496f22dda813d5d99 2023-03-30 16:55:50,210 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/73ef6dc201cd4c3496f22dda813d5d99, entries=4, sequenceid=13, filesize=5.5 K 2023-03-30 16:55:50,211 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/37b1f7283df742b6850ab4b86d4abbc6 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/37b1f7283df742b6850ab4b86d4abbc6 2023-03-30 16:55:50,214 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/37b1f7283df742b6850ab4b86d4abbc6, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:55:50,215 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0f1908d0b8069b3bb15eeb0c2b924834 in 611ms, sequenceid=13, compaction requested=true 2023-03-30 16:55:50,215 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:50,215 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:50,215 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:50,534 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330cc7ab27469cc4fcab92aa930bb9a31ee to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230330cc7ab27469cc4fcab92aa930bb9a31ee 2023-03-30 16:55:50,541 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/d557f6bc9906497b8cdcafc450e4fb09 2023-03-30 16:55:50,546 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/d0746a2d6bbc457f81048213c505f2ed as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/d0746a2d6bbc457f81048213c505f2ed 2023-03-30 16:55:50,572 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/d0746a2d6bbc457f81048213c505f2ed, entries=4, sequenceid=13, filesize=5.5 K 2023-03-30 16:55:50,573 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/d557f6bc9906497b8cdcafc450e4fb09 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d557f6bc9906497b8cdcafc450e4fb09 2023-03-30 16:55:50,577 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d557f6bc9906497b8cdcafc450e4fb09, entries=2, sequenceid=13, filesize=5.1 K 2023-03-30 16:55:50,578 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c7695a45c92e578f7e75f346d842c67c in 974ms, sequenceid=13, compaction requested=true 2023-03-30 16:55:50,578 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:50,578 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:50,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:50,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:50,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-30 16:55:50,578 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-30 16:55:50,580 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,580 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:50,580 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,580 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:50,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:50,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:50,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:50,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-30 16:55:50,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60eedec6[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:50,582 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-30 16:55:50,582 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,584 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-30 16:55:50,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-30 16:55:50,584 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:50,584 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,584 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-30 16:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:50,585 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-30 16:55:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:50,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:50,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:50,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-30 16:55:50,588 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-30 16:55:50,588 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:50,588 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:50,588 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-30 16:55:50,588 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:50,589 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,589 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:50,589 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:50,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:50,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:50,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,591 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:50,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:50,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,592 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:50,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:50,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:50,594 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:50,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:50,594 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-30 16:55:50,594 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:50,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:50,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:50,594 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,595 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,595 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:50,595 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,595 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:50,595 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:50,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:50,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:50,695 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:50,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:50,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:50,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:50,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-30 16:55:50,700 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:50,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:50,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-30 16:55:50,704 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-30 16:55:50,704 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:50,704 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-30 16:55:50,704 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-30 16:55:50,704 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,704 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:50,709 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:50,709 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:50,709 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:50,709 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:50,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:50,710 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-30 16:55:50,711 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-30 16:55:50,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-30 16:55:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-30 16:55:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-30 16:55:50,712 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:50,712 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. started... 2023-03-30 16:55:50,712 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:50,712 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. started... 2023-03-30 16:55:50,712 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0f1908d0b8069b3bb15eeb0c2b924834 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:55:50,712 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c7695a45c92e578f7e75f346d842c67c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:55:50,715 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:50,715 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:50,715 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:50,715 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. started... 2023-03-30 16:55:50,715 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0380f23217501ebeee416907da941edc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-30 16:55:50,779 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303305c3abf84955f4ab89d6abc88b8232193 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303305c3abf84955f4ab89d6abc88b8232193 2023-03-30 16:55:50,781 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303308e22dc06296541eca42217a0c9731bec to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303308e22dc06296541eca42217a0c9731bec 2023-03-30 16:55:50,788 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330cd6cf3261a52475bb984511387ed1010 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330cd6cf3261a52475bb984511387ed1010 2023-03-30 16:55:50,825 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650 2023-03-30 16:55:50,860 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303302d1b997928a444b3ad02f71385579c54 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303302d1b997928a444b3ad02f71385579c54 2023-03-30 16:55:50,865 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/934cdb7cde244115bdc0ea1e040a4d31 2023-03-30 16:55:50,868 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650 2023-03-30 16:55:50,905 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650, entries=4, sequenceid=17, filesize=5.5 K 2023-03-30 16:55:50,906 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/934cdb7cde244115bdc0ea1e040a4d31 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/934cdb7cde244115bdc0ea1e040a4d31 2023-03-30 16:55:50,909 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/934cdb7cde244115bdc0ea1e040a4d31, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:55:50,910 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0380f23217501ebeee416907da941edc in 195ms, sequenceid=17, compaction requested=true 2023-03-30 16:55:50,910 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:50,910 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:50,910 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:51,210 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e 2023-03-30 16:55:51,223 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/076d56f45e1a44c68716c5a172b2974d 2023-03-30 16:55:51,266 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330bf085016bf164554b247a688312e6176 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230330bf085016bf164554b247a688312e6176 2023-03-30 16:55:51,284 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/ca701421fc79456d9daf6481346d572c 2023-03-30 16:55:51,285 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230330b027e121b1ab4493897d0eb58bbb0b65 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230330b027e121b1ab4493897d0eb58bbb0b65 2023-03-30 16:55:51,288 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e 2023-03-30 16:55:51,314 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/82ccaeb8f1a54705a29e64db453089d1 2023-03-30 16:55:51,319 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/076d56f45e1a44c68716c5a172b2974d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/076d56f45e1a44c68716c5a172b2974d 2023-03-30 16:55:51,334 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e, entries=4, sequenceid=17, filesize=5.5 K 2023-03-30 16:55:51,335 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/ca701421fc79456d9daf6481346d572c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/ca701421fc79456d9daf6481346d572c 2023-03-30 16:55:51,341 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/ca701421fc79456d9daf6481346d572c, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:55:51,342 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0f1908d0b8069b3bb15eeb0c2b924834 in 630ms, sequenceid=17, compaction requested=true 2023-03-30 16:55:51,342 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:51,342 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:51,342 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:51,363 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/076d56f45e1a44c68716c5a172b2974d, entries=4, sequenceid=17, filesize=5.5 K 2023-03-30 16:55:51,364 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/82ccaeb8f1a54705a29e64db453089d1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/82ccaeb8f1a54705a29e64db453089d1 2023-03-30 16:55:51,368 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/82ccaeb8f1a54705a29e64db453089d1, entries=2, sequenceid=17, filesize=5.1 K 2023-03-30 16:55:51,369 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c7695a45c92e578f7e75f346d842c67c in 657ms, sequenceid=17, compaction requested=true 2023-03-30 16:55:51,369 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:51,369 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-30 16:55:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-30 16:55:51,370 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,370 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:51,371 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,371 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:51,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-30 16:55:51,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@543a6dc3[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:51,372 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-30 16:55:51,373 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,374 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-30 16:55:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-30 16:55:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:51,374 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,374 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:51,375 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-30 16:55:51,375 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,375 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:51,375 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-30 16:55:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:51,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-30 16:55:51,377 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-30 16:55:51,377 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:51,377 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:51,377 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-30 16:55:51,377 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:51,380 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,380 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:51,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:51,380 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,381 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:51,381 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:51,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:51,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:51,385 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-30 16:55:51,385 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:51,385 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:51,385 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:51,386 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:51,386 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:51,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:51,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-30 16:55:51,486 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:51,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:51,495 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:51,503 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:51,512 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:51,513 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:51,530 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-30 16:55:51,643 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-30 16:55:51,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-30 16:55:51,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-30 16:55:51,649 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-30 16:55:51,649 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:51,649 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-30 16:55:51,649 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-30 16:55:51,650 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,650 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:51,651 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:51,651 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:51,651 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:51,651 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-30 16:55:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:51,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-30 16:55:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:51,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-30 16:55:51,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-30 16:55:51,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-30 16:55:51,656 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-30 16:55:51,656 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-30 16:55:51,656 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-30 16:55:51,659 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:51,659 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. started... 2023-03-30 16:55:51,659 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0f1908d0b8069b3bb15eeb0c2b924834 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:55:51,660 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:51,660 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-30 16:55:51,660 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-30 16:55:51,660 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:51,660 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. started... 2023-03-30 16:55:51,660 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0380f23217501ebeee416907da941edc 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:55:51,661 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. started... 2023-03-30 16:55:51,662 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c7695a45c92e578f7e75f346d842c67c 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-30 16:55:51,787 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/919b1467a8b846098efb7fc064b5946c 2023-03-30 16:55:51,817 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 919b1467a8b846098efb7fc064b5946c 2023-03-30 16:55:52,132 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/e3d9affea1e64d51a4cfcc9a86df7665 2023-03-30 16:55:52,163 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3d9affea1e64d51a4cfcc9a86df7665 2023-03-30 16:55:52,170 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/87056416196240a2ad1105072a1a72f2 2023-03-30 16:55:52,197 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87056416196240a2ad1105072a1a72f2 2023-03-30 16:55:52,210 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/d1911582f2bf42648cd67763b05f130d 2023-03-30 16:55:52,213 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1911582f2bf42648cd67763b05f130d 2023-03-30 16:55:52,214 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/87056416196240a2ad1105072a1a72f2 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/87056416196240a2ad1105072a1a72f2 2023-03-30 16:55:52,238 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87056416196240a2ad1105072a1a72f2 2023-03-30 16:55:52,238 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/87056416196240a2ad1105072a1a72f2, entries=3, sequenceid=23, filesize=5.2 K 2023-03-30 16:55:52,239 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/d1911582f2bf42648cd67763b05f130d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d1911582f2bf42648cd67763b05f130d 2023-03-30 16:55:52,242 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1911582f2bf42648cd67763b05f130d 2023-03-30 16:55:52,242 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d1911582f2bf42648cd67763b05f130d, entries=1, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:52,243 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c7695a45c92e578f7e75f346d842c67c in 581ms, sequenceid=23, compaction requested=true 2023-03-30 16:55:52,243 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:52,243 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:52,243 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-30 16:55:52,589 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/c5061a9f95ab48d8a98957e1cfdf3686 2023-03-30 16:55:52,593 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5061a9f95ab48d8a98957e1cfdf3686 2023-03-30 16:55:52,594 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/e3d9affea1e64d51a4cfcc9a86df7665 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/e3d9affea1e64d51a4cfcc9a86df7665 2023-03-30 16:55:52,618 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3d9affea1e64d51a4cfcc9a86df7665 2023-03-30 16:55:52,618 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/e3d9affea1e64d51a4cfcc9a86df7665, entries=3, sequenceid=23, filesize=5.2 K 2023-03-30 16:55:52,619 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/c5061a9f95ab48d8a98957e1cfdf3686 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/c5061a9f95ab48d8a98957e1cfdf3686 2023-03-30 16:55:52,623 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5061a9f95ab48d8a98957e1cfdf3686 2023-03-30 16:55:52,623 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/c5061a9f95ab48d8a98957e1cfdf3686, entries=1, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:52,624 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0f1908d0b8069b3bb15eeb0c2b924834 in 965ms, sequenceid=23, compaction requested=true 2023-03-30 16:55:52,624 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:52,624 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:52,624 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-30 16:55:52,638 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/58850e6c759f4274910b70f3c8371c48 2023-03-30 16:55:52,641 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58850e6c759f4274910b70f3c8371c48 2023-03-30 16:55:52,642 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/919b1467a8b846098efb7fc064b5946c as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/919b1467a8b846098efb7fc064b5946c 2023-03-30 16:55:52,674 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 919b1467a8b846098efb7fc064b5946c 2023-03-30 16:55:52,674 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/919b1467a8b846098efb7fc064b5946c, entries=3, sequenceid=23, filesize=5.2 K 2023-03-30 16:55:52,675 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/58850e6c759f4274910b70f3c8371c48 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/58850e6c759f4274910b70f3c8371c48 2023-03-30 16:55:52,679 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58850e6c759f4274910b70f3c8371c48 2023-03-30 16:55:52,679 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/58850e6c759f4274910b70f3c8371c48, entries=1, sequenceid=23, filesize=5.0 K 2023-03-30 16:55:52,680 INFO [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0380f23217501ebeee416907da941edc in 1019ms, sequenceid=23, compaction requested=true 2023-03-30 16:55:52,680 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:52,680 DEBUG [rs(jenkins-hbase4.apache.org,39029,1680195214375)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-30 16:55:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-30 16:55:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-30 16:55:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-30 16:55:52,681 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,681 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:52,682 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,682 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-30 16:55:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:52,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39029,1680195214375' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-30 16:55:52,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e775b67[Count = 0] remaining members to acquire global barrier 2023-03-30 16:55:52,683 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-30 16:55:52,683 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,685 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,685 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-30 16:55:52,685 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-30 16:55:52,686 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39029,1680195214375' in zk 2023-03-30 16:55:52,685 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,686 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-30 16:55:52,687 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,687 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-30 16:55:52,687 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:52,687 DEBUG [member: 'jenkins-hbase4.apache.org,39029,1680195214375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-30 16:55:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39029,1680195214375': 2023-03-30 16:55:52,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39029,1680195214375' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-30 16:55:52,692 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-30 16:55:52,692 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-30 16:55:52,692 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-30 16:55:52,692 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-30 16:55:52,693 INFO [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-30 16:55:52,694 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-30 16:55:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-30 16:55:52,694 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:52,694 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:52,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:52,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-30 16:55:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:52,695 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-30 16:55:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,696 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-30 16:55:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-30 16:55:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:52,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-30 16:55:52,699 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-30 16:55:52,699 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-30 16:55:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:52,699 DEBUG [(jenkins-hbase4.apache.org,44093,1680195213114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-30 16:55:52,699 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-30 16:55:52,700 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-30 16:55:52,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-30 16:55:52,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-30 16:55:52,800 DEBUG [Listener at localhost/41799] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-30 16:55:52,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44093] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-30 16:55:52,801 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:52,801 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 0f1908d0b8069b3bb15eeb0c2b924834/family1 is initiating major compaction (all files) 2023-03-30 16:55:52,802 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:52,802 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:52,802 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 0f1908d0b8069b3bb15eeb0c2b924834/family1 in testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:52,802 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f169055c657c4a5b89f5368c970f226c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f4ebd68c6e8b4410b1fcde3721df8597, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/73ef6dc201cd4c3496f22dda813d5d99, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/e3d9affea1e64d51a4cfcc9a86df7665] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp, totalSize=27.1 K 2023-03-30 16:55:52,802 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting f169055c657c4a5b89f5368c970f226c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195346913 2023-03-30 16:55:52,803 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting f4ebd68c6e8b4410b1fcde3721df8597, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195348431 2023-03-30 16:55:52,803 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 73ef6dc201cd4c3496f22dda813d5d99, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195349593 2023-03-30 16:55:52,803 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting c2bb3816c99b4e3ebbcc7d2a38bdf85e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195350697 2023-03-30 16:55:52,804 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting e3d9affea1e64d51a4cfcc9a86df7665, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:52,813 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 0f1908d0b8069b3bb15eeb0c2b924834#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:52,852 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023033062df0259d2464791a5998c73696b5b97_del 2023-03-30 16:55:52,852 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033062df0259d2464791a5998c73696b5b97_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023033062df0259d2464791a5998c73696b5b97_del 2023-03-30 16:55:53,315 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ed4721c519d4221bd895a08807cd60d 2023-03-30 16:55:53,316 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family1/2ed4721c519d4221bd895a08807cd60d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/2ed4721c519d4221bd895a08807cd60d 2023-03-30 16:55:53,348 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ed4721c519d4221bd895a08807cd60d 2023-03-30 16:55:53,349 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f1908d0b8069b3bb15eeb0c2b924834/family1 of 0f1908d0b8069b3bb15eeb0c2b924834 into 2ed4721c519d4221bd895a08807cd60d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:53,350 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:53,350 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:53,350 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 0f1908d0b8069b3bb15eeb0c2b924834/family2 is initiating major compaction (all files) 2023-03-30 16:55:53,350 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:53,350 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:53,351 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 0f1908d0b8069b3bb15eeb0c2b924834/family2 in testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:53,351 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/d12cfb28522e49789e6a0da916ab2487, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/54f2340236394e809be1badb15d6646a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/37b1f7283df742b6850ab4b86d4abbc6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/ca701421fc79456d9daf6481346d572c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/c5061a9f95ab48d8a98957e1cfdf3686] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp, totalSize=25.4 K 2023-03-30 16:55:53,351 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d12cfb28522e49789e6a0da916ab2487, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195346913 2023-03-30 16:55:53,352 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 54f2340236394e809be1badb15d6646a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195348431 2023-03-30 16:55:53,352 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 37b1f7283df742b6850ab4b86d4abbc6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195349593 2023-03-30 16:55:53,353 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting ca701421fc79456d9daf6481346d572c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195350697 2023-03-30 16:55:53,353 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting c5061a9f95ab48d8a98957e1cfdf3686, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:53,362 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 0f1908d0b8069b3bb15eeb0c2b924834#family2#compaction#198 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:53,369 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230330972af8efad224204a413ffd8d58b740b_del 2023-03-30 16:55:53,369 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330972af8efad224204a413ffd8d58b740b_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230330972af8efad224204a413ffd8d58b740b_del 2023-03-30 16:55:53,381 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef4324167d7e409ba30a64642402e3ee 2023-03-30 16:55:53,381 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/.tmp/family2/ef4324167d7e409ba30a64642402e3ee as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/ef4324167d7e409ba30a64642402e3ee 2023-03-30 16:55:53,385 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef4324167d7e409ba30a64642402e3ee 2023-03-30 16:55:53,385 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f1908d0b8069b3bb15eeb0c2b924834/family2 of 0f1908d0b8069b3bb15eeb0c2b924834 into ef4324167d7e409ba30a64642402e3ee(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:53,386 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:53,386 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:53,386 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): c7695a45c92e578f7e75f346d842c67c/family1 is initiating major compaction (all files) 2023-03-30 16:55:53,386 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:53,387 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:53,387 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of c7695a45c92e578f7e75f346d842c67c/family1 in testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:53,387 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/02c95dd495814f81a6e6966fcec1276c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/e8bc32fe3dc847afa39a8e73c969df51, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/d0746a2d6bbc457f81048213c505f2ed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/076d56f45e1a44c68716c5a172b2974d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/87056416196240a2ad1105072a1a72f2] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp, totalSize=27.1 K 2023-03-30 16:55:53,387 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 02c95dd495814f81a6e6966fcec1276c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195346915 2023-03-30 16:55:53,388 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting e8bc32fe3dc847afa39a8e73c969df51, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195348432 2023-03-30 16:55:53,388 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d0746a2d6bbc457f81048213c505f2ed, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195349594 2023-03-30 16:55:53,389 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 076d56f45e1a44c68716c5a172b2974d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195350697 2023-03-30 16:55:53,389 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 87056416196240a2ad1105072a1a72f2, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:53,398 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): c7695a45c92e578f7e75f346d842c67c#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:53,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f169055c657c4a5b89f5368c970f226c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f4ebd68c6e8b4410b1fcde3721df8597, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/73ef6dc201cd4c3496f22dda813d5d99, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/e3d9affea1e64d51a4cfcc9a86df7665] to archive 2023-03-30 16:55:53,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:53,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f169055c657c4a5b89f5368c970f226c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f169055c657c4a5b89f5368c970f226c 2023-03-30 16:55:53,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f4ebd68c6e8b4410b1fcde3721df8597 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/f4ebd68c6e8b4410b1fcde3721df8597 2023-03-30 16:55:53,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/73ef6dc201cd4c3496f22dda813d5d99 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/73ef6dc201cd4c3496f22dda813d5d99 2023-03-30 16:55:53,450 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/c2bb3816c99b4e3ebbcc7d2a38bdf85e 2023-03-30 16:55:53,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/e3d9affea1e64d51a4cfcc9a86df7665 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/e3d9affea1e64d51a4cfcc9a86df7665 2023-03-30 16:55:53,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/d12cfb28522e49789e6a0da916ab2487, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/54f2340236394e809be1badb15d6646a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/37b1f7283df742b6850ab4b86d4abbc6, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/ca701421fc79456d9daf6481346d572c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/c5061a9f95ab48d8a98957e1cfdf3686] to archive 2023-03-30 16:55:53,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:53,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/d12cfb28522e49789e6a0da916ab2487 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/d12cfb28522e49789e6a0da916ab2487 2023-03-30 16:55:53,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/54f2340236394e809be1badb15d6646a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/54f2340236394e809be1badb15d6646a 2023-03-30 16:55:53,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/37b1f7283df742b6850ab4b86d4abbc6 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/37b1f7283df742b6850ab4b86d4abbc6 2023-03-30 16:55:53,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/ca701421fc79456d9daf6481346d572c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/ca701421fc79456d9daf6481346d572c 2023-03-30 16:55:53,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/c5061a9f95ab48d8a98957e1cfdf3686 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family2/c5061a9f95ab48d8a98957e1cfdf3686 2023-03-30 16:55:53,846 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303308b743aa750a54040bd6239c21c97d838_del 2023-03-30 16:55:53,846 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303308b743aa750a54040bd6239c21c97d838_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303308b743aa750a54040bd6239c21c97d838_del 2023-03-30 16:55:54,312 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5552a92d69c48cd8e9092bce2fbeba8 2023-03-30 16:55:54,312 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family1/c5552a92d69c48cd8e9092bce2fbeba8 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/c5552a92d69c48cd8e9092bce2fbeba8 2023-03-30 16:55:54,345 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5552a92d69c48cd8e9092bce2fbeba8 2023-03-30 16:55:54,346 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c7695a45c92e578f7e75f346d842c67c/family1 of c7695a45c92e578f7e75f346d842c67c into c5552a92d69c48cd8e9092bce2fbeba8(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:54,346 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:54,346 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:54,346 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): c7695a45c92e578f7e75f346d842c67c/family2 is initiating major compaction (all files) 2023-03-30 16:55:54,346 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:54,346 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:54,346 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of c7695a45c92e578f7e75f346d842c67c/family2 in testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:54,347 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/92ddae4c0aa14e109eff7b5e8a60e5ce, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/271405bfac4e4c9ab54a8602f9440320, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d557f6bc9906497b8cdcafc450e4fb09, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/82ccaeb8f1a54705a29e64db453089d1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d1911582f2bf42648cd67763b05f130d] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp, totalSize=25.4 K 2023-03-30 16:55:54,347 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 92ddae4c0aa14e109eff7b5e8a60e5ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195346915 2023-03-30 16:55:54,347 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 271405bfac4e4c9ab54a8602f9440320, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195348432 2023-03-30 16:55:54,348 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d557f6bc9906497b8cdcafc450e4fb09, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195349594 2023-03-30 16:55:54,349 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 82ccaeb8f1a54705a29e64db453089d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195350697 2023-03-30 16:55:54,349 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting d1911582f2bf42648cd67763b05f130d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:54,358 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): c7695a45c92e578f7e75f346d842c67c#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:54,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/02c95dd495814f81a6e6966fcec1276c, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/e8bc32fe3dc847afa39a8e73c969df51, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/d0746a2d6bbc457f81048213c505f2ed, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/076d56f45e1a44c68716c5a172b2974d, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/87056416196240a2ad1105072a1a72f2] to archive 2023-03-30 16:55:54,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:54,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/02c95dd495814f81a6e6966fcec1276c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/02c95dd495814f81a6e6966fcec1276c 2023-03-30 16:55:54,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/e8bc32fe3dc847afa39a8e73c969df51 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/e8bc32fe3dc847afa39a8e73c969df51 2023-03-30 16:55:54,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/d0746a2d6bbc457f81048213c505f2ed to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/d0746a2d6bbc457f81048213c505f2ed 2023-03-30 16:55:54,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/076d56f45e1a44c68716c5a172b2974d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/076d56f45e1a44c68716c5a172b2974d 2023-03-30 16:55:54,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/87056416196240a2ad1105072a1a72f2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/87056416196240a2ad1105072a1a72f2 2023-03-30 16:55:54,766 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303300a73dbee6f8f41079ee1b860b6fc08bb_del 2023-03-30 16:55:54,766 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303300a73dbee6f8f41079ee1b860b6fc08bb_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303300a73dbee6f8f41079ee1b860b6fc08bb_del 2023-03-30 16:55:55,579 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a53acfa975a24f55832b9dddac8e2b3d 2023-03-30 16:55:55,580 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/.tmp/family2/a53acfa975a24f55832b9dddac8e2b3d as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/a53acfa975a24f55832b9dddac8e2b3d 2023-03-30 16:55:55,584 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a53acfa975a24f55832b9dddac8e2b3d 2023-03-30 16:55:55,586 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c7695a45c92e578f7e75f346d842c67c/family2 of c7695a45c92e578f7e75f346d842c67c into a53acfa975a24f55832b9dddac8e2b3d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-30 16:55:55,586 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:55,586 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:55,586 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 0380f23217501ebeee416907da941edc/family1 is initiating major compaction (all files) 2023-03-30 16:55:55,586 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:55,586 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:55,586 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 0380f23217501ebeee416907da941edc/family1 in testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:55,586 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/b5bf299a72224b0da06250c5e39ea080, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/ad82192504334a34b77e0a708ed2bbbb, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/9454838571b0489ea0a0c1e216cb45b8, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/919b1467a8b846098efb7fc064b5946c] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp, totalSize=27.1 K 2023-03-30 16:55:55,587 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting b5bf299a72224b0da06250c5e39ea080, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195346914 2023-03-30 16:55:55,587 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting ad82192504334a34b77e0a708ed2bbbb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195348432 2023-03-30 16:55:55,588 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 9454838571b0489ea0a0c1e216cb45b8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195349594 2023-03-30 16:55:55,588 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting c1d1e5d7ae1a4fc79e8a81bfff61d650, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195350697 2023-03-30 16:55:55,588 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 919b1467a8b846098efb7fc064b5946c, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:55,597 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 0380f23217501ebeee416907da941edc#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:55,639 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303302496db373c904636a7f3c2d50c7786f2_del 2023-03-30 16:55:55,640 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303302496db373c904636a7f3c2d50c7786f2_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303302496db373c904636a7f3c2d50c7786f2_del 2023-03-30 16:55:55,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/92ddae4c0aa14e109eff7b5e8a60e5ce, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/271405bfac4e4c9ab54a8602f9440320, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d557f6bc9906497b8cdcafc450e4fb09, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/82ccaeb8f1a54705a29e64db453089d1, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d1911582f2bf42648cd67763b05f130d] to archive 2023-03-30 16:55:55,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:55,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/92ddae4c0aa14e109eff7b5e8a60e5ce to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/92ddae4c0aa14e109eff7b5e8a60e5ce 2023-03-30 16:55:55,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/271405bfac4e4c9ab54a8602f9440320 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/271405bfac4e4c9ab54a8602f9440320 2023-03-30 16:55:55,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d557f6bc9906497b8cdcafc450e4fb09 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d557f6bc9906497b8cdcafc450e4fb09 2023-03-30 16:55:55,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/82ccaeb8f1a54705a29e64db453089d1 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/82ccaeb8f1a54705a29e64db453089d1 2023-03-30 16:55:55,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d1911582f2bf42648cd67763b05f130d to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family2/d1911582f2bf42648cd67763b05f130d 2023-03-30 16:55:56,112 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 632ae1c7471d40d0a377c36e13fc1234 2023-03-30 16:55:56,112 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family1/632ae1c7471d40d0a377c36e13fc1234 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/632ae1c7471d40d0a377c36e13fc1234 2023-03-30 16:55:56,146 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 632ae1c7471d40d0a377c36e13fc1234 2023-03-30 16:55:56,148 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0380f23217501ebeee416907da941edc/family1 of 0380f23217501ebeee416907da941edc into 632ae1c7471d40d0a377c36e13fc1234(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:56,148 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:56,148 DEBUG [Listener at localhost/41799] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-30 16:55:56,148 DEBUG [Listener at localhost/41799] regionserver.HStore(1912): 0380f23217501ebeee416907da941edc/family2 is initiating major compaction (all files) 2023-03-30 16:55:56,148 INFO [Listener at localhost/41799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-30 16:55:56,148 INFO [Listener at localhost/41799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-30 16:55:56,148 INFO [Listener at localhost/41799] regionserver.HRegion(2259): Starting compaction of 0380f23217501ebeee416907da941edc/family2 in testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:56,148 INFO [Listener at localhost/41799] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/f1241ec499a445e2a95a55ded286d6c2, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/a60c334d9d61492a8c9130fe4aee5cd9, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/bed0a0be69dc49f7ab66c8ddbeea288a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/934cdb7cde244115bdc0ea1e040a4d31, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/58850e6c759f4274910b70f3c8371c48] into tmpdir=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp, totalSize=25.4 K 2023-03-30 16:55:56,149 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting f1241ec499a445e2a95a55ded286d6c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680195346914 2023-03-30 16:55:56,149 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting a60c334d9d61492a8c9130fe4aee5cd9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680195348432 2023-03-30 16:55:56,150 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting bed0a0be69dc49f7ab66c8ddbeea288a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680195349594 2023-03-30 16:55:56,150 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 934cdb7cde244115bdc0ea1e040a4d31, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680195350697 2023-03-30 16:55:56,150 DEBUG [Listener at localhost/41799] compactions.Compactor(207): Compacting 58850e6c759f4274910b70f3c8371c48, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-30 16:55:56,161 INFO [Listener at localhost/41799] throttle.PressureAwareThroughputController(145): 0380f23217501ebeee416907da941edc#family2#compaction#202 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-30 16:55:56,172 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230330b433f888d1014a4ca4218a5760762eb4_del 2023-03-30 16:55:56,172 INFO [Listener at localhost/41799] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330b433f888d1014a4ca4218a5760762eb4_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230330b433f888d1014a4ca4218a5760762eb4_del 2023-03-30 16:55:56,188 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7821620126004826a3ab3f6eb1834698 2023-03-30 16:55:56,189 DEBUG [Listener at localhost/41799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/.tmp/family2/7821620126004826a3ab3f6eb1834698 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/7821620126004826a3ab3f6eb1834698 2023-03-30 16:55:56,192 INFO [Listener at localhost/41799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7821620126004826a3ab3f6eb1834698 2023-03-30 16:55:56,194 INFO [Listener at localhost/41799] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0380f23217501ebeee416907da941edc/family2 of 0380f23217501ebeee416907da941edc into 7821620126004826a3ab3f6eb1834698(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-30 16:55:56,194 DEBUG [Listener at localhost/41799] regionserver.HRegion(2289): Compaction status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:56,197 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:56,200 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:56,203 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:56,204 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:56,209 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44093] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC6l\xEF\xA6d\xEB\xAF\xB5_\xA4\xDB\xC0S\x0C\x02n"\x10-\xEDi\x8FY\xF9\x12D \x0En'\x06UMF*\x10\xD03B\x8B/\xE5\x12P[\xF3\xB6\x1D\xE6\xEE\x0Fm2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-30 16:55:56,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-30 16:55:56,237 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-30 16:55:56,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:55:56,237 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680195956237 2023-03-30 16:55:56,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-30 16:55:56,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/b5bf299a72224b0da06250c5e39ea080, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/ad82192504334a34b77e0a708ed2bbbb, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/9454838571b0489ea0a0c1e216cb45b8, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/919b1467a8b846098efb7fc064b5946c] to archive 2023-03-30 16:55:56,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:56,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/b5bf299a72224b0da06250c5e39ea080 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/b5bf299a72224b0da06250c5e39ea080 2023-03-30 16:55:56,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/ad82192504334a34b77e0a708ed2bbbb to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/ad82192504334a34b77e0a708ed2bbbb 2023-03-30 16:55:56,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/9454838571b0489ea0a0c1e216cb45b8 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/9454838571b0489ea0a0c1e216cb45b8 2023-03-30 16:55:56,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/c1d1e5d7ae1a4fc79e8a81bfff61d650 2023-03-30 16:55:56,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/919b1467a8b846098efb7fc064b5946c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/919b1467a8b846098efb7fc064b5946c 2023-03-30 16:55:56,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/f1241ec499a445e2a95a55ded286d6c2, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/a60c334d9d61492a8c9130fe4aee5cd9, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/bed0a0be69dc49f7ab66c8ddbeea288a, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/934cdb7cde244115bdc0ea1e040a4d31, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/58850e6c759f4274910b70f3c8371c48] to archive 2023-03-30 16:55:56,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:56,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/f1241ec499a445e2a95a55ded286d6c2 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/f1241ec499a445e2a95a55ded286d6c2 2023-03-30 16:55:56,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/a60c334d9d61492a8c9130fe4aee5cd9 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/a60c334d9d61492a8c9130fe4aee5cd9 2023-03-30 16:55:56,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/bed0a0be69dc49f7ab66c8ddbeea288a to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/bed0a0be69dc49f7ab66c8ddbeea288a 2023-03-30 16:55:56,293 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:55:56,293 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c20834d to 127.0.0.1:64100 2023-03-30 16:55:56,293 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:56,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/934cdb7cde244115bdc0ea1e040a4d31 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/934cdb7cde244115bdc0ea1e040a4d31 2023-03-30 16:55:56,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/58850e6c759f4274910b70f3c8371c48 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family2/58850e6c759f4274910b70f3c8371c48 2023-03-30 16:55:56,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-30 16:55:56,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023033062df0259d2464791a5998c73696b5b97_del 2023-03-30 16:55:56,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303302496db373c904636a7f3c2d50c7786f2_del 2023-03-30 16:55:56,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303308b743aa750a54040bd6239c21c97d838_del 2023-03-30 16:55:56,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:56,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] zookeeper.ReadOnlyZKClient(139): Connect 0x32c90ba1 to 127.0.0.1:64100 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-30 16:55:56,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5756f081, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-30 16:55:56,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230330 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-30 16:55:57,451 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033016fa24c7cb60477fa39e841aacf6276c to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023033016fa24c7cb60477fa39e841aacf6276c 2023-03-30 16:55:57,452 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:57,470 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-30 16:55:57,473 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-30 16:55:57,488 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-30 16:55:57,491 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-30 16:55:57,544 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230330/family1/6ba184dde85547f0a0a98657d3d2a1b9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-30 16:55:57,545 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230330/family1/6ba184dde85547f0a0a98657d3d2a1b9}] 2023-03-30 16:55:57,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230330/family1/6ba184dde85547f0a0a98657d3d2a1b9 for inclusion in c7695a45c92e578f7e75f346d842c67c/family1 2023-03-30 16:55:57,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-30 16:55:57,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-30 16:55:57,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:57,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230330/family1/6ba184dde85547f0a0a98657d3d2a1b9 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__d4b913ndfjldrt90t5a2h7amrsl9gahmvqtu474cvopsi2dmhoe76vv4mclou050/family1/6ba184dde85547f0a0a98657d3d2a1b9 2023-03-30 16:55:57,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__d4b913ndfjldrt90t5a2h7amrsl9gahmvqtu474cvopsi2dmhoe76vv4mclou050/family1/6ba184dde85547f0a0a98657d3d2a1b9 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/30a37b51a5d8468e901fb996d5d7f8e9_SeqId_28_ 2023-03-30 16:55:57,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__d4b913ndfjldrt90t5a2h7amrsl9gahmvqtu474cvopsi2dmhoe76vv4mclou050/family1/6ba184dde85547f0a0a98657d3d2a1b9 into c7695a45c92e578f7e75f346d842c67c/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/30a37b51a5d8468e901fb996d5d7f8e9_SeqId_28_ - updating store file list. 2023-03-30 16:55:57,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/30a37b51a5d8468e901fb996d5d7f8e9_SeqId_28_ into c7695a45c92e578f7e75f346d842c67c/family1 2023-03-30 16:55:57,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__d4b913ndfjldrt90t5a2h7amrsl9gahmvqtu474cvopsi2dmhoe76vv4mclou050/family1/6ba184dde85547f0a0a98657d3d2a1b9 into c7695a45c92e578f7e75f346d842c67c/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/family1/30a37b51a5d8468e901fb996d5d7f8e9_SeqId_28_) 2023-03-30 16:55:57,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__d4b913ndfjldrt90t5a2h7amrsl9gahmvqtu474cvopsi2dmhoe76vv4mclou050/family1/6ba184dde85547f0a0a98657d3d2a1b9 2023-03-30 16:55:57,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230330 table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:57,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:57,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330530abe1572154996becd4dde6527514e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330530abe1572154996becd4dde6527514e 2023-03-30 16:55:57,611 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330825d07570e104a6cbc63925be3f884a3 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330825d07570e104a6cbc63925be3f884a3 2023-03-30 16:55:57,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303308e22dc06296541eca42217a0c9731bec to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303308e22dc06296541eca42217a0c9731bec 2023-03-30 16:55:57,613 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330d6aea8941c1d4bc58fa8d6d1400d798e to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230330d6aea8941c1d4bc58fa8d6d1400d798e 2023-03-30 16:55:57,613 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-30 16:55:57,613 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230330' 2023-03-30 16:55:57,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230330 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-30 16:55:57,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230330 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-30 16:55:58,182 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230330a5bc23466cb6408483d2c9a40efc5c47 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330a5bc23466cb6408483d2c9a40efc5c47 2023-03-30 16:55:58,183 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:58,262 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230330/family1/85410b0cc98d405c9cad898c03800a6b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-30 16:55:58,263 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230330/family1/85410b0cc98d405c9cad898c03800a6b}] 2023-03-30 16:55:58,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230330/family1/85410b0cc98d405c9cad898c03800a6b for inclusion in 0380f23217501ebeee416907da941edc/family1 2023-03-30 16:55:58,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-30 16:55:58,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-30 16:55:58,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:58,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230330/family1/85410b0cc98d405c9cad898c03800a6b to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__12up42roogfl7pbbrcfbahk5ntl00jpqdg4u6m5j7la49n8ph0c1p9tdn4gbnqin/family1/85410b0cc98d405c9cad898c03800a6b 2023-03-30 16:55:58,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__12up42roogfl7pbbrcfbahk5ntl00jpqdg4u6m5j7la49n8ph0c1p9tdn4gbnqin/family1/85410b0cc98d405c9cad898c03800a6b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/1236fbea22a04e5389ca959a293635a8_SeqId_28_ 2023-03-30 16:55:58,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__12up42roogfl7pbbrcfbahk5ntl00jpqdg4u6m5j7la49n8ph0c1p9tdn4gbnqin/family1/85410b0cc98d405c9cad898c03800a6b into 0380f23217501ebeee416907da941edc/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/1236fbea22a04e5389ca959a293635a8_SeqId_28_ - updating store file list. 2023-03-30 16:55:58,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/1236fbea22a04e5389ca959a293635a8_SeqId_28_ into 0380f23217501ebeee416907da941edc/family1 2023-03-30 16:55:58,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__12up42roogfl7pbbrcfbahk5ntl00jpqdg4u6m5j7la49n8ph0c1p9tdn4gbnqin/family1/85410b0cc98d405c9cad898c03800a6b into 0380f23217501ebeee416907da941edc/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/family1/1236fbea22a04e5389ca959a293635a8_SeqId_28_) 2023-03-30 16:55:58,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__12up42roogfl7pbbrcfbahk5ntl00jpqdg4u6m5j7la49n8ph0c1p9tdn4gbnqin/family1/85410b0cc98d405c9cad898c03800a6b 2023-03-30 16:55:58,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230330 table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:58,338 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:58,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303305c0b8bfc523d41808df00948bbad9033 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303305c0b8bfc523d41808df00948bbad9033 2023-03-30 16:55:58,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330cd6cf3261a52475bb984511387ed1010 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330cd6cf3261a52475bb984511387ed1010 2023-03-30 16:55:58,349 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330d9f79103d5dd40c8b0945074bf58d667 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330d9f79103d5dd40c8b0945074bf58d667 2023-03-30 16:55:58,350 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330e685c290e61641f19c3e39b43cd7b115 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230330e685c290e61641f19c3e39b43cd7b115 2023-03-30 16:55:58,351 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-30 16:55:58,351 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230330' 2023-03-30 16:55:58,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230330 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-30 16:55:58,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230330 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-30 16:55:58,554 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230330b3f1edc2fb594da5bd7c7a57f83054de to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230330b3f1edc2fb594da5bd7c7a57f83054de 2023-03-30 16:55:58,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:58,663 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230330/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-30 16:55:58,669 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834., hostname=jenkins-hbase4.apache.org,39029,1680195214375, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230330/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f}] 2023-03-30 16:55:58,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(763): Validating hfile at hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230330/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f for inclusion in 0f1908d0b8069b3bb15eeb0c2b924834/family1 2023-03-30 16:55:58,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-30 16:55:58,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(777): Region bounds: first= last=1 2023-03-30 16:55:58,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegion(2446): Flush status journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:58,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230330/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__cnhgd9u1rh659qu8i2acm47enbq4g6n083cb6cd0ljt1dq1dlgeq0ogjcudv5q49/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f 2023-03-30 16:55:58,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__cnhgd9u1rh659qu8i2acm47enbq4g6n083cb6cd0ljt1dq1dlgeq0ogjcudv5q49/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/75e23b631dba4ffd9451041aacf456ca_SeqId_28_ 2023-03-30 16:55:58,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(849): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__cnhgd9u1rh659qu8i2acm47enbq4g6n083cb6cd0ljt1dq1dlgeq0ogjcudv5q49/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f into 0f1908d0b8069b3bb15eeb0c2b924834/family1 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/75e23b631dba4ffd9451041aacf456ca_SeqId_28_ - updating store file list. 2023-03-30 16:55:58,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(882): Loaded HFile hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/75e23b631dba4ffd9451041aacf456ca_SeqId_28_ into 0f1908d0b8069b3bb15eeb0c2b924834/family1 2023-03-30 16:55:58,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.HStore(855): Successfully loaded hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__cnhgd9u1rh659qu8i2acm47enbq4g6n083cb6cd0ljt1dq1dlgeq0ogjcudv5q49/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f into 0f1908d0b8069b3bb15eeb0c2b924834/family1 (new location: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/family1/75e23b631dba4ffd9451041aacf456ca_SeqId_28_) 2023-03-30 16:55:58,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39029] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/staging/jenkins__testMajorCompactionFromAdmin__cnhgd9u1rh659qu8i2acm47enbq4g6n083cb6cd0ljt1dq1dlgeq0ogjcudv5q49/family1/b85b3d0056ef4a818ed4dfd8afdb3a9f 2023-03-30 16:55:58,735 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230330 table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:58,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:58,737 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230330459bfce2a65e434797e2a38bcfbf04df to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230330459bfce2a65e434797e2a38bcfbf04df 2023-03-30 16:55:58,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303305c3abf84955f4ab89d6abc88b8232193 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303305c3abf84955f4ab89d6abc88b8232193 2023-03-30 16:55:58,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303307e68a36968014093a3958a81107afe5f to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303307e68a36968014093a3958a81107afe5f 2023-03-30 16:55:58,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303307ff33b8416f7493db6fb80813e2e5f49 to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303307ff33b8416f7493db6fb80813e2e5f49 2023-03-30 16:55:58,740 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-30 16:55:58,740 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230330' 2023-03-30 16:55:58,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230330 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-30 16:55:58,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-30 16:55:58,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-30 16:55:58,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023033062df0259d2464791a5998c73696b5b97_del] 2023-03-30 16:55:58,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:58,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023033062df0259d2464791a5998c73696b5b97_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023033062df0259d2464791a5998c73696b5b97_del 2023-03-30 16:55:58,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-30 16:55:58,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303302496db373c904636a7f3c2d50c7786f2_del] 2023-03-30 16:55:58,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:58,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303302496db373c904636a7f3c2d50c7786f2_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303302496db373c904636a7f3c2d50c7786f2_del 2023-03-30 16:55:58,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-30 16:55:58,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303308b743aa750a54040bd6239c21c97d838_del] 2023-03-30 16:55:58,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] backup.HFileArchiver(360): Archiving compacted files. 2023-03-30 16:55:58,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303308b743aa750a54040bd6239c21c97d838_del to hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303308b743aa750a54040bd6239c21c97d838_del 2023-03-30 16:55:58,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-30 16:55:58,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680195219315] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-30 16:55:58,750 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-30 16:55:58,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.5150 sec 2023-03-30 16:55:58,770 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:58,772 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:58,775 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-30 16:55:58,776 DEBUG [Listener at localhost/41799] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-30 16:55:58,781 INFO [Listener at localhost/41799] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-30 16:55:58,838 INFO [Listener at localhost/41799] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 250), OpenFileDescriptor=664 (was 639) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=453 (was 368) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4331 (was 4335) 2023-03-30 16:55:58,838 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b586bb5 to 127.0.0.1:64100 2023-03-30 16:55:58,838 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:58,838 INFO [Listener at localhost/41799] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-30 16:55:58,838 INFO [Listener at localhost/41799] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-30 16:55:58,838 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x561bf69b to 127.0.0.1:64100 2023-03-30 16:55:58,838 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:58,838 DEBUG [Listener at localhost/41799] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-30 16:55:58,839 DEBUG [Listener at localhost/41799] util.JVMClusterUtil(257): Found active master hash=836116940, stopped=false 2023-03-30 16:55:58,839 INFO [Listener at localhost/41799] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:55:58,841 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-30 16:55:58,841 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-30 16:55:58,841 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:55:58,846 INFO [Listener at localhost/41799] procedure2.ProcedureExecutor(629): Stopping 2023-03-30 16:55:58,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-30 16:55:58,846 DEBUG [Listener at localhost/41799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03a472e5 to 127.0.0.1:64100 2023-03-30 16:55:58,846 DEBUG [Listener at localhost/41799] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:58,846 INFO [Listener at localhost/41799] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39029,1680195214375' ***** 2023-03-30 16:55:58,846 INFO [Listener at localhost/41799] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-30 16:55:58,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-30 16:55:58,847 INFO [RS:0;jenkins-hbase4:39029] regionserver.HeapMemoryManager(220): Stopping 2023-03-30 16:55:58,847 INFO [RS:0;jenkins-hbase4:39029] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-30 16:55:58,847 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-30 16:55:58,847 INFO [RS:0;jenkins-hbase4:39029] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-30 16:55:58,847 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 800b35d7d26b9866a6511c5f834c181c 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 80c0ffabf06d7dad81c5f34fac612af6 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 6b6ff4ad9c20b14af117117618318156 2023-03-30 16:55:58,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 800b35d7d26b9866a6511c5f834c181c, disabling compactions & flushes 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 530b2a08fdec00a887d0a81479c49486 2023-03-30 16:55:58,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for f0fc9e1c2a385007d6f3a1a6db901efe 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for b29fad251876ccdb28c1e80a93ea7325 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 311a5d950d0b7283733d4b334d0089ff 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 1f8a0a60d7251e694608e48a5753817d 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for d3e85d08c9236402a775ce01ab813cef 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for f23fa6fb2a6b590b388346ecbb7010d3 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 0f1908d0b8069b3bb15eeb0c2b924834 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 803f43c55f4cd7fc65b94b0eb61debde 2023-03-30 16:55:58,848 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for f8da1b06ca1f9816201b026631e89817 2023-03-30 16:55:58,849 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for f3661297582531e1192ae5a5b00b4811 2023-03-30 16:55:58,849 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for dac04c396edf38306458db05404e6c7d 2023-03-30 16:55:58,849 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for b31111cc3a5f132de53c40f2d4319373 2023-03-30 16:55:58,849 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for c7695a45c92e578f7e75f346d842c67c 2023-03-30 16:55:58,849 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 9cc307f3f7cba7ac9b36daf0f32feb92 2023-03-30 16:55:58,849 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 0380f23217501ebeee416907da941edc 2023-03-30 16:55:58,849 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:58,849 DEBUG [RS:0;jenkins-hbase4:39029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc9aab2 to 127.0.0.1:64100 2023-03-30 16:55:58,849 DEBUG [RS:0;jenkins-hbase4:39029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:58,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:55:58,850 INFO [RS:0;jenkins-hbase4:39029] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-30 16:55:58,850 INFO [RS:0;jenkins-hbase4:39029] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-30 16:55:58,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. after waiting 0 ms 2023-03-30 16:55:58,850 INFO [RS:0;jenkins-hbase4:39029] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-30 16:55:58,850 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-30 16:55:58,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:55:58,850 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-30 16:55:58,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-30 16:55:58,850 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-30 16:55:58,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-30 16:55:58,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-30 16:55:58,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-30 16:55:58,850 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-30 16:55:58,851 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1505): Waiting on 0380f23217501ebeee416907da941edc, 0f1908d0b8069b3bb15eeb0c2b924834, 1588230740, 1f8a0a60d7251e694608e48a5753817d, 311a5d950d0b7283733d4b334d0089ff, 530b2a08fdec00a887d0a81479c49486, 6b6ff4ad9c20b14af117117618318156, 800b35d7d26b9866a6511c5f834c181c, 803f43c55f4cd7fc65b94b0eb61debde, 80c0ffabf06d7dad81c5f34fac612af6, 9cc307f3f7cba7ac9b36daf0f32feb92, b29fad251876ccdb28c1e80a93ea7325, b31111cc3a5f132de53c40f2d4319373, c7695a45c92e578f7e75f346d842c67c, d3e85d08c9236402a775ce01ab813cef, dac04c396edf38306458db05404e6c7d, f0fc9e1c2a385007d6f3a1a6db901efe, f23fa6fb2a6b590b388346ecbb7010d3, f3661297582531e1192ae5a5b00b4811, f8da1b06ca1f9816201b026631e89817, fadbe83bb5f1f6bef301518ccc05dca3 2023-03-30 16:55:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/800b35d7d26b9866a6511c5f834c181c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-30 16:55:58,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:55:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 800b35d7d26b9866a6511c5f834c181c: 2023-03-30 16:55:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1680195249931.800b35d7d26b9866a6511c5f834c181c. 2023-03-30 16:55:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80c0ffabf06d7dad81c5f34fac612af6, disabling compactions & flushes 2023-03-30 16:55:58,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. after waiting 0 ms 2023-03-30 16:55:58,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:58,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/80c0ffabf06d7dad81c5f34fac612af6/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-30 16:55:58,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:58,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80c0ffabf06d7dad81c5f34fac612af6: 2023-03-30 16:55:58,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1680195288892.80c0ffabf06d7dad81c5f34fac612af6. 2023-03-30 16:55:58,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6b6ff4ad9c20b14af117117618318156, disabling compactions & flushes 2023-03-30 16:55:58,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:55:58,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:55:58,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. after waiting 0 ms 2023-03-30 16:55:58,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:55:58,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyPolicy/6b6ff4ad9c20b14af117117618318156/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-30 16:55:58,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:55:58,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6b6ff4ad9c20b14af117117618318156: 2023-03-30 16:55:58,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1680195252592.6b6ff4ad9c20b14af117117618318156. 2023-03-30 16:55:58,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 530b2a08fdec00a887d0a81479c49486, disabling compactions & flushes 2023-03-30 16:55:58,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:55:58,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:55:58,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. after waiting 0 ms 2023-03-30 16:55:58,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:55:58,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/530b2a08fdec00a887d0a81479c49486/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-30 16:55:58,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:55:58,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 530b2a08fdec00a887d0a81479c49486: 2023-03-30 16:55:58,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680195219489.530b2a08fdec00a887d0a81479c49486. 2023-03-30 16:55:58,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fadbe83bb5f1f6bef301518ccc05dca3, disabling compactions & flushes 2023-03-30 16:55:58,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:58,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:58,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. after waiting 0 ms 2023-03-30 16:55:58,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:58,896 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-30 16:55:58,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/fadbe83bb5f1f6bef301518ccc05dca3/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-30 16:55:58,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:58,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fadbe83bb5f1f6bef301518ccc05dca3: 2023-03-30 16:55:58,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1680195288892.fadbe83bb5f1f6bef301518ccc05dca3. 2023-03-30 16:55:58,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f0fc9e1c2a385007d6f3a1a6db901efe, disabling compactions & flushes 2023-03-30 16:55:58,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:55:58,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:55:58,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. after waiting 0 ms 2023-03-30 16:55:58,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:55:58,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f0fc9e1c2a385007d6f3a1a6db901efe/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-30 16:55:58,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:55:58,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f0fc9e1c2a385007d6f3a1a6db901efe: 2023-03-30 16:55:58,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680195276970.f0fc9e1c2a385007d6f3a1a6db901efe. 2023-03-30 16:55:58,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b29fad251876ccdb28c1e80a93ea7325, disabling compactions & flushes 2023-03-30 16:55:58,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:58,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:58,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. after waiting 0 ms 2023-03-30 16:55:58,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:58,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testCompactionWithHFileLink/b29fad251876ccdb28c1e80a93ea7325/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-30 16:55:58,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:58,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b29fad251876ccdb28c1e80a93ea7325: 2023-03-30 16:55:58,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1680195288892.b29fad251876ccdb28c1e80a93ea7325. 2023-03-30 16:55:58,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 311a5d950d0b7283733d4b334d0089ff, disabling compactions & flushes 2023-03-30 16:55:58,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:55:58,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:55:58,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. after waiting 0 ms 2023-03-30 16:55:58,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:55:58,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/311a5d950d0b7283733d4b334d0089ff/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-30 16:55:58,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:55:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 311a5d950d0b7283733d4b334d0089ff: 2023-03-30 16:55:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1680195249931.311a5d950d0b7283733d4b334d0089ff. 2023-03-30 16:55:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1f8a0a60d7251e694608e48a5753817d, disabling compactions & flushes 2023-03-30 16:55:58,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:55:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:55:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. after waiting 0 ms 2023-03-30 16:55:58,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:55:58,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithWeeklyPolicy/1f8a0a60d7251e694608e48a5753817d/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-30 16:55:58,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1f8a0a60d7251e694608e48a5753817d: 2023-03-30 16:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1680195238038.1f8a0a60d7251e694608e48a5753817d. 2023-03-30 16:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d3e85d08c9236402a775ce01ab813cef, disabling compactions & flushes 2023-03-30 16:55:58,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. after waiting 0 ms 2023-03-30 16:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:58,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/d3e85d08c9236402a775ce01ab813cef/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-30 16:55:58,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d3e85d08c9236402a775ce01ab813cef: 2023-03-30 16:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1680195314509.d3e85d08c9236402a775ce01ab813cef. 2023-03-30 16:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f23fa6fb2a6b590b388346ecbb7010d3, disabling compactions & flushes 2023-03-30 16:55:58,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. after waiting 0 ms 2023-03-30 16:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:58,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMinorCompactionWithMonthlyPolicy/f23fa6fb2a6b590b388346ecbb7010d3/recovered.edits/51.seqid, newMaxSeqId=51, maxSeqId=1 2023-03-30 16:55:58,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f23fa6fb2a6b590b388346ecbb7010d3: 2023-03-30 16:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1680195332658.f23fa6fb2a6b590b388346ecbb7010d3. 2023-03-30 16:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f1908d0b8069b3bb15eeb0c2b924834, disabling compactions & flushes 2023-03-30 16:55:58,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. after waiting 0 ms 2023-03-30 16:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:58,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0f1908d0b8069b3bb15eeb0c2b924834/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-30 16:55:58,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:58,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f1908d0b8069b3bb15eeb0c2b924834: 2023-03-30 16:55:58,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1680195344761.0f1908d0b8069b3bb15eeb0c2b924834. 2023-03-30 16:55:58,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 803f43c55f4cd7fc65b94b0eb61debde, disabling compactions & flushes 2023-03-30 16:55:58,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:58,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:58,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. after waiting 0 ms 2023-03-30 16:55:58,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:58,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/803f43c55f4cd7fc65b94b0eb61debde/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-30 16:55:58,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:58,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 803f43c55f4cd7fc65b94b0eb61debde: 2023-03-30 16:55:58,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1680195314509.803f43c55f4cd7fc65b94b0eb61debde. 2023-03-30 16:55:58,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f8da1b06ca1f9816201b026631e89817, disabling compactions & flushes 2023-03-30 16:55:58,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:55:58,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:55:58,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. after waiting 0 ms 2023-03-30 16:55:58,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:55:58,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithMonthlyPolicy/f8da1b06ca1f9816201b026631e89817/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-30 16:55:58,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:55:58,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f8da1b06ca1f9816201b026631e89817: 2023-03-30 16:55:58,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1680195230253.f8da1b06ca1f9816201b026631e89817. 2023-03-30 16:55:58,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3661297582531e1192ae5a5b00b4811, disabling compactions & flushes 2023-03-30 16:55:58,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:55:58,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:55:58,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. after waiting 0 ms 2023-03-30 16:55:58,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:55:58,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f3661297582531e1192ae5a5b00b4811 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-30 16:55:58,950 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-30 16:55:59,051 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1505): Waiting on 0380f23217501ebeee416907da941edc, 1588230740, 9cc307f3f7cba7ac9b36daf0f32feb92, b31111cc3a5f132de53c40f2d4319373, c7695a45c92e578f7e75f346d842c67c, dac04c396edf38306458db05404e6c7d, f3661297582531e1192ae5a5b00b4811 2023-03-30 16:55:59,251 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1505): Waiting on 0380f23217501ebeee416907da941edc, 1588230740, 9cc307f3f7cba7ac9b36daf0f32feb92, b31111cc3a5f132de53c40f2d4319373, c7695a45c92e578f7e75f346d842c67c, dac04c396edf38306458db05404e6c7d, f3661297582531e1192ae5a5b00b4811 2023-03-30 16:55:59,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/.tmp/info/baa10941dff84202800ad76905d0f81f 2023-03-30 16:55:59,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baa10941dff84202800ad76905d0f81f 2023-03-30 16:55:59,295 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/.tmp/rep_barrier/940f7f9e60c04c3387454f69cff4b173 2023-03-30 16:55:59,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 940f7f9e60c04c3387454f69cff4b173 2023-03-30 16:55:59,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/.tmp/info/28851084fdd547caba8e302975094e0b 2023-03-30 16:55:59,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/.tmp/info/28851084fdd547caba8e302975094e0b as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/info/28851084fdd547caba8e302975094e0b 2023-03-30 16:55:59,354 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-30 16:55:59,354 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-30 16:55:59,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/info/28851084fdd547caba8e302975094e0b, entries=3, sequenceid=7, filesize=4.8 K 2023-03-30 16:55:59,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for f3661297582531e1192ae5a5b00b4811 in 417ms, sequenceid=7, compaction requested=false 2023-03-30 16:55:59,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/namespace/f3661297582531e1192ae5a5b00b4811/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-30 16:55:59,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:55:59,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3661297582531e1192ae5a5b00b4811: 2023-03-30 16:55:59,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1680195217781.f3661297582531e1192ae5a5b00b4811. 2023-03-30 16:55:59,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dac04c396edf38306458db05404e6c7d, disabling compactions & flushes 2023-03-30 16:55:59,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:55:59,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:55:59,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. after waiting 0 ms 2023-03-30 16:55:59,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testScannerOnBulkLoadRefHFiles/dac04c396edf38306458db05404e6c7d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-30 16:55:59,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dac04c396edf38306458db05404e6c7d: 2023-03-30 16:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1680195249931.dac04c396edf38306458db05404e6c7d. 2023-03-30 16:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b31111cc3a5f132de53c40f2d4319373, disabling compactions & flushes 2023-03-30 16:55:59,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. after waiting 0 ms 2023-03-30 16:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:55:59,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b31111cc3a5f132de53c40f2d4319373/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-30 16:55:59,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:55:59,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b31111cc3a5f132de53c40f2d4319373: 2023-03-30 16:55:59,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680195262814.b31111cc3a5f132de53c40f2d4319373. 2023-03-30 16:55:59,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7695a45c92e578f7e75f346d842c67c, disabling compactions & flushes 2023-03-30 16:55:59,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:59,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:59,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. after waiting 0 ms 2023-03-30 16:55:59,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:59,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/c7695a45c92e578f7e75f346d842c67c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-30 16:55:59,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7695a45c92e578f7e75f346d842c67c: 2023-03-30 16:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1680195344761.c7695a45c92e578f7e75f346d842c67c. 2023-03-30 16:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9cc307f3f7cba7ac9b36daf0f32feb92, disabling compactions & flushes 2023-03-30 16:55:59,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. after waiting 0 ms 2023-03-30 16:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:59,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/ns/testMinorCompaction/9cc307f3f7cba7ac9b36daf0f32feb92/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-30 16:55:59,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:59,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9cc307f3f7cba7ac9b36daf0f32feb92: 2023-03-30 16:55:59,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1680195314509.9cc307f3f7cba7ac9b36daf0f32feb92. 2023-03-30 16:55:59,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0380f23217501ebeee416907da941edc, disabling compactions & flushes 2023-03-30 16:55:59,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:59,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:59,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. after waiting 0 ms 2023-03-30 16:55:59,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:59,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/default/testMajorCompactionFromAdmin/0380f23217501ebeee416907da941edc/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-30 16:55:59,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:59,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0380f23217501ebeee416907da941edc: 2023-03-30 16:55:59,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1680195344761.0380f23217501ebeee416907da941edc. 2023-03-30 16:55:59,452 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-30 16:55:59,652 DEBUG [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-30 16:55:59,689 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-30 16:55:59,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/.tmp/table/d150474058914988b82aa82c6d22f4ec 2023-03-30 16:55:59,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d150474058914988b82aa82c6d22f4ec 2023-03-30 16:55:59,714 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/.tmp/info/baa10941dff84202800ad76905d0f81f as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/info/baa10941dff84202800ad76905d0f81f 2023-03-30 16:55:59,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baa10941dff84202800ad76905d0f81f 2023-03-30 16:55:59,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/info/baa10941dff84202800ad76905d0f81f, entries=226, sequenceid=130, filesize=37.9 K 2023-03-30 16:55:59,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/.tmp/rep_barrier/940f7f9e60c04c3387454f69cff4b173 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/rep_barrier/940f7f9e60c04c3387454f69cff4b173 2023-03-30 16:55:59,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 940f7f9e60c04c3387454f69cff4b173 2023-03-30 16:55:59,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/rep_barrier/940f7f9e60c04c3387454f69cff4b173, entries=1, sequenceid=130, filesize=5.0 K 2023-03-30 16:55:59,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/.tmp/table/d150474058914988b82aa82c6d22f4ec as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/table/d150474058914988b82aa82c6d22f4ec 2023-03-30 16:55:59,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d150474058914988b82aa82c6d22f4ec 2023-03-30 16:55:59,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/table/d150474058914988b82aa82c6d22f4ec, entries=27, sequenceid=130, filesize=6.6 K 2023-03-30 16:55:59,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 876ms, sequenceid=130, compaction requested=false 2023-03-30 16:55:59,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-30 16:55:59,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-30 16:55:59,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-30 16:55:59,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-30 16:55:59,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-30 16:55:59,852 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39029,1680195214375; all regions closed. 2023-03-30 16:55:59,860 DEBUG [RS:0;jenkins-hbase4:39029] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/oldWALs 2023-03-30 16:55:59,860 INFO [RS:0;jenkins-hbase4:39029] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39029%2C1680195214375.meta:.meta(num 1680195217527) 2023-03-30 16:55:59,864 DEBUG [RS:0;jenkins-hbase4:39029] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/oldWALs 2023-03-30 16:55:59,864 INFO [RS:0;jenkins-hbase4:39029] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39029%2C1680195214375:(num 1680195216503) 2023-03-30 16:55:59,864 DEBUG [RS:0;jenkins-hbase4:39029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:59,864 INFO [RS:0;jenkins-hbase4:39029] regionserver.LeaseManager(133): Closed leases 2023-03-30 16:55:59,864 INFO [RS:0;jenkins-hbase4:39029] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-30 16:55:59,864 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-30 16:55:59,865 INFO [RS:0;jenkins-hbase4:39029] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39029 2023-03-30 16:55:59,875 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39029,1680195214375 2023-03-30 16:55:59,875 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-30 16:55:59,875 ERROR [Listener at localhost/41799-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e20e19c rejected from java.util.concurrent.ThreadPoolExecutor@3a1f6280[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-30 16:55:59,876 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-30 16:55:59,876 ERROR [Listener at localhost/41799-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@773dc53d rejected from java.util.concurrent.ThreadPoolExecutor@3a1f6280[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-30 16:55:59,877 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39029,1680195214375] 2023-03-30 16:55:59,877 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39029,1680195214375; numProcessing=1 2023-03-30 16:55:59,878 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39029,1680195214375 already deleted, retry=false 2023-03-30 16:55:59,878 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39029,1680195214375 expired; onlineServers=0 2023-03-30 16:55:59,878 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44093,1680195213114' ***** 2023-03-30 16:55:59,878 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-30 16:55:59,879 DEBUG [M:0;jenkins-hbase4:44093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70eb2bf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-30 16:55:59,879 INFO [M:0;jenkins-hbase4:44093] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44093,1680195213114 2023-03-30 16:55:59,879 INFO [M:0;jenkins-hbase4:44093] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44093,1680195213114; all regions closed. 2023-03-30 16:55:59,879 DEBUG [M:0;jenkins-hbase4:44093] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-30 16:55:59,879 DEBUG [M:0;jenkins-hbase4:44093] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-30 16:55:59,879 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-30 16:55:59,879 DEBUG [M:0;jenkins-hbase4:44093] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-30 16:55:59,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1680195216261] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1680195216261,5,FailOnTimeoutGroup] 2023-03-30 16:55:59,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1680195216262] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1680195216262,5,FailOnTimeoutGroup] 2023-03-30 16:55:59,879 INFO [M:0;jenkins-hbase4:44093] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-30 16:55:59,879 INFO [M:0;jenkins-hbase4:44093] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-30 16:55:59,880 INFO [M:0;jenkins-hbase4:44093] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-03-30 16:55:59,880 DEBUG [M:0;jenkins-hbase4:44093] master.HMaster(1512): Stopping service threads 2023-03-30 16:55:59,880 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-30 16:55:59,880 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-30 16:55:59,880 INFO [M:0;jenkins-hbase4:44093] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-30 16:55:59,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-30 16:55:59,881 ERROR [M:0;jenkins-hbase4:44093] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-30 16:55:59,881 INFO [M:0;jenkins-hbase4:44093] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-30 16:55:59,881 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-30 16:55:59,882 DEBUG [M:0;jenkins-hbase4:44093] zookeeper.ZKUtil(398): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-30 16:55:59,882 WARN [M:0;jenkins-hbase4:44093] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-30 16:55:59,882 INFO [M:0;jenkins-hbase4:44093] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-30 16:55:59,882 INFO [M:0;jenkins-hbase4:44093] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-30 16:55:59,882 DEBUG [M:0;jenkins-hbase4:44093] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-30 16:55:59,882 INFO [M:0;jenkins-hbase4:44093] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:55:59,882 DEBUG [M:0;jenkins-hbase4:44093] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:55:59,882 DEBUG [M:0;jenkins-hbase4:44093] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-30 16:55:59,882 DEBUG [M:0;jenkins-hbase4:44093] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:55:59,882 INFO [M:0;jenkins-hbase4:44093] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.75 KB heapSize=598.57 KB 2023-03-30 16:55:59,977 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-30 16:55:59,977 INFO [RS:0;jenkins-hbase4:39029] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39029,1680195214375; zookeeper connection closed. 2023-03-30 16:55:59,977 ERROR [Listener at localhost/41799-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fe28660 rejected from java.util.concurrent.ThreadPoolExecutor@3a1f6280[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-30 16:55:59,977 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): regionserver:39029-0x10136583da40001, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-30 16:55:59,977 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@47578399] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@47578399 2023-03-30 16:55:59,977 ERROR [Listener at localhost/41799-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63f3e1e rejected from java.util.concurrent.ThreadPoolExecutor@3a1f6280[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-30 16:55:59,978 INFO [Listener at localhost/41799] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-30 16:56:00,289 INFO [M:0;jenkins-hbase4:44093] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.75 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f6fb30482014b87b4c56694252904f4 2023-03-30 16:56:00,293 INFO [M:0;jenkins-hbase4:44093] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f6fb30482014b87b4c56694252904f4 2023-03-30 16:56:00,293 DEBUG [M:0;jenkins-hbase4:44093] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f6fb30482014b87b4c56694252904f4 as hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f6fb30482014b87b4c56694252904f4 2023-03-30 16:56:00,296 INFO [M:0;jenkins-hbase4:44093] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f6fb30482014b87b4c56694252904f4 2023-03-30 16:56:00,296 INFO [M:0;jenkins-hbase4:44093] regionserver.HStore(1080): Added hdfs://localhost:37679/user/jenkins/test-data/ec0645fd-1e39-55cb-9ea8-bb7e3a8cdd70/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f6fb30482014b87b4c56694252904f4, entries=123, sequenceid=1005, filesize=33.3 K 2023-03-30 16:56:00,297 INFO [M:0;jenkins-hbase4:44093] regionserver.HRegion(2948): Finished flush of dataSize ~512.75 KB/525061, heapSize ~598.55 KB/612920, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1005, compaction requested=false 2023-03-30 16:56:00,298 INFO [M:0;jenkins-hbase4:44093] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-30 16:56:00,298 DEBUG [M:0;jenkins-hbase4:44093] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-30 16:56:00,300 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-30 16:56:00,300 INFO [M:0;jenkins-hbase4:44093] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-30 16:56:00,301 INFO [M:0;jenkins-hbase4:44093] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44093 2023-03-30 16:56:00,304 DEBUG [M:0;jenkins-hbase4:44093] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44093,1680195213114 already deleted, retry=false 2023-03-30 16:56:00,406 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-30 16:56:00,406 INFO [M:0;jenkins-hbase4:44093] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44093,1680195213114; zookeeper connection closed. 2023-03-30 16:56:00,406 ERROR [Listener at localhost/41799-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1025a49d rejected from java.util.concurrent.ThreadPoolExecutor@15585090[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 905] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-30 16:56:00,406 DEBUG [Listener at localhost/41799-EventThread] zookeeper.ZKWatcher(600): master:44093-0x10136583da40000, quorum=127.0.0.1:64100, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-30 16:56:00,406 ERROR [Listener at localhost/41799-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@646beade rejected from java.util.concurrent.ThreadPoolExecutor@15585090[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 905] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-30 16:56:00,407 WARN [Listener at localhost/41799] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-30 16:56:00,410 INFO [Listener at localhost/41799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-30 16:56:00,517 WARN [BP-1191206018-172.31.14.131-1680195209774 heartbeating to localhost/127.0.0.1:37679] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-30 16:56:00,517 WARN [BP-1191206018-172.31.14.131-1680195209774 heartbeating to localhost/127.0.0.1:37679] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1191206018-172.31.14.131-1680195209774 (Datanode Uuid 3bd02d61-c173-4cd3-a740-242f059d5e2c) service to localhost/127.0.0.1:37679 2023-03-30 16:56:00,520 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77/dfs/data/data1/current/BP-1191206018-172.31.14.131-1680195209774] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-30 16:56:00,520 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1d1d7667-f4a2-77f4-77ba-f1fa0e2d30e8/cluster_8191e6c3-e7f8-5a4b-52bc-c5b57b0b2a77/dfs/data/data2/current/BP-1191206018-172.31.14.131-1680195209774] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-30 16:56:00,541 INFO [Listener at localhost/41799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-30 16:56:00,672 INFO [Listener at localhost/41799] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-30 16:56:00,750 INFO [Listener at localhost/41799] hbase.HBaseTestingUtility(1293): Minicluster is down